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of  human  operator  performance  in  a  variety  of  practical  tasks.  Although  the 
predominate  theme  focuses  on  application  to  aircraft  control  and  handling 
qualities,  papers  were  also  presented  concerning  human  control  of  automobiles. 
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DECISION  BEHAVIOR  WITH  CHANGING  SIGNAL  STRENGTH 


Renwick  E.  Curry  and  Eliezer  G.  Gal 
Massachusetts  Institute  of  Technology 
Cambridge,  Massachusetts 

and 

D~vid  C.  Nagel 

National  Aeronautics  and  Space  Administration 
Ames  Research  Center 
Moffett  Field,  California 

ABSTRACT 

The  Theory  of  Signal  Detectability  (TSD)  has  nearly  replaced  classical  notions 
of  the  threshold  because  of  its  ability  to  separate  sensory  and  decision  processes 
in  weak  signal  detection  and  recognition  paradigms.  The  primary  emphasis  of  recent 
work  ha3  concentrated  on  the  sensory  rather  than  the  decision  aspects  and  almost 
all  work  has  been  exclusively  at  one  signal  strength.  We  propose  a  model  to 
describe  behavior  at  different  signal  strengths  based  on  subjective  rather  than 
objective  distributions.  The  model  predicts  ensemble  performance  at  a  constant 
objective  likelihood  ratio  (LR)  criterion  (even  though  subjective  distributions 
are  the  basis  for  determining  cutoff  criteria)  unless  the  observer  adepts  a 
subjective  Neyman-Pearson  objective.  Results  from  an  experiment  in  visual  discrim¬ 
ination  show  that  some  observers  in  fact  operate  at  a  constant  objective  LR's  as 
signal  strength  is  varied  randomly  over  a  wide  range.  The  objective  LR's  of  the 
other  subjects  changed  dramatically  with  signal  strength,  but  this  behavior  is 
consistent  with  the  use  of  a  subjective  Neyman-Pearson  decision  rule  and  the 
linear  relation  between  subjective  and  objective  log  LR's  found  in  studies  of 
subjective  probability. 


1 


INTRODUCTION 


In  this  paper  we  consider  In  some  detail  the  decision  aspects  of 
the  Theory  of  Signal  Detectability  (TSD)  that  has  found  wide  application 
In  the  psychophysics  of  the  past  several  decades,  particularly  as  a  model 
for  psychophysical  detection  and  recognition  tasks.  Although  the  theory 
was  first  detailed  by  Swets,  Tanner  and  Blrdsall  (1955),  Green  and  Swets  (1966) 
provide  the  moat  detailed  discussion  of  the  concept  and  applications  of 
the  general  model.  As  with  the  majority  of  expositions  of  TSD,  we 
consider  here  the  case  of  two  alternative  stimulus  classes,  which  In 
the  theory  are  represented  as  hypotheses.  Each  presentation  of  a  stlmu.'us 
is  assumed  to  map  to  a  unidimensional  sensory  continuum;  the  continuum 
Is  divided  Into  Intervals  and  (neglecting  boundary  or  criterion  variability) 
u  realization  of  the  stimulus  anywhere  within  that  Interval  leads  to  a 
unique  response. 

TSD,  In  common  with  the  more  modern  of  the  threshold  theories,  has 
allowed  the  experimental  separation  of  the  sensory  and  response  elements 
of  psychophysics.  In  the  present  context,  the  sensory  elements  are 
derived  from  the  ensemble  distributions  of  the  realizations  for  each  stim¬ 
ulus.  It  Is  the  normalized  distance  between  these  distributions  (com¬ 
monly  referred  to  as  the  signal  strength  or  signal- to-noise  ratio  (SNR)), 
that  determines  the  sensory  capabilities,  whereac  the  response  elements 
are  defined  by  the  points  separating  the  Intervals  on  the  continuum. 

In  the  formal  application  of  TSD  as  a  normative  and  descriptive 
theory,  the  sensory  continuum  has  been  Identified  with  the  likelihood 
ratio  (LR),  or  a  monotonic  function  of  the  LR  (see  Green  and  Swets,  1966). 
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Early  experiments  (e.g.  Egan,  Schulman  and  Greenberg,  1959;  Tanner, 

Swets  and  Green,  1956)  were  performed  to  Investigate  the  manipulation 
of  the  response  criterion  levels.  Results  were  generally  as  predicted 
by  the  theory,  although  real  observers  tended  to  be  somewhat  more 
conservative  than  the  normative  theory  would  hrve  It,  and  research 
efforts  then  concentrated  on  the  sensory  rather  than  the  decison  as¬ 
pects  of  the  model,  In  large  measure.  With  this  change  of  emphasis ,  the 
concept  of  the  likelihood  ratio  decision  axis  seemed  overrestrlctlve 
and  unnecessary.  This  fact,  coupled  with  some  logical  Inconsistencies, 
especially  the  non-monotonic  behavior  of  LR  for  the  unequal-variance  Gau¬ 
ssian  distributions,  led  to  new  theori~u  which  did  not  rely  on  the  LR 
(Wickelgren,  1968)  and  which  began  to  fall  more  In  line  with  the  Thur- 
stonlan  view  (see  Lee,  1969  for  a  comparison  of  TSD  and  Thurstonian 
scaling) . 

The  demise  of  the  LR  concept,  however,  created  a  void  In  one  im¬ 
portant  element  of  the  sensory  continuum  threshold  models;  namely,  what 
sort  of  decision  or  choice  behavior  does  one  expect  for  the  stimulus 
situations  where  signal  strength  is  allowed  to  vary  from  trial  to  trial? 
Indeed,  the  theory  has  never  been  fully  examined  under  these  stringent 
conditions.  As  treated  in  developments  to  follow,  the  task  of  the  deaision 
maker  Is  to  determine  which  one  of  two  hypotheses  is  true  from  one  avail¬ 
able  observation.  To  make  decisions  in  an  optimal  manner,  the  following 
objectives  might  be  considered  (e.g.  see  Green,  1960): 

1.  Maximize  percent  correct 

2.  Maximize  expected  value 

3.  Maximize  P(Hit)  -  B*P (False  Alarm) 

4.  Maximize  a  posteriori  probability 


3 


5.  Maximize  P(Hlt)  at  fixed  P(False  Alarm),  commonly  known  aa 
the  Neyman-Pear8on  obj active. 

As  shown  by  Green  and  Swets,  the  optimal  strategy  for  all  of  the  above 
objectives  at  a  given  SNR  is  to  base  decisions  on  the  LR,  viz.  respond 
"Ho"  if  the  LR  is  less  than  some  value,  otherwise  repond  "H]",  where 
'(Ho.Hj)  are  the  two  alternative  hypotheses.  This  poses  obvious  diffi¬ 
culties  if  one  is  trying  to  determine  the  objective  of  a  decision  maker 
for  which  only  the  inputs  and  outputs  can  be  observed,  since  many 
objective  functions  can  lead  to  the  same  criterion  value  at  a  fixed 
signal  strength. 

The  next  logical  step  to  obtain  an  identification  of  the  objective 
of  a  normative  decision  maker  is  to  change  the  distributions  from  which 
the  observations  are  drawn,  i.e.  the  SNR.  This  is  conceptually  of  limiting 
value,  however,  for  a  perusal  of  LR  criterion  levels  shows  that  only  the 
NeymanrPearson  objective  predicts  a  change  in  LR  criterion  level  with 
SNR.  All  other  LR  criteria  levels  remain  constant  regardless  of  the  ob¬ 
jective  being  extremallzed  or  changes  in  signal  strength. 

To  our  knowledge  only  Kinchla  and  Smyzer  (1967)  have  performed 
experiments  where  different  detectibilities  were  an  important  aspect  of 
the  design,  although  certain  of  those  interested  in  trlal-to-trlal  adap¬ 
tive  effects  in  psychophysical  experiments  have  used  zero-  or  half-strength 
trials  in  an  attempt  to  measure  the  effects  of  certain  kinds  of  response 
bias  (Atkinson  and  Kinchla,  1965;  Ahumada,  1972).  In  these  latter  cases, 
however,  TSD  was  not  the  model  being  examined.  Where  Kinchla  and  Smyzer 
emphasize  the  sensory  and  perceptual  mechanisms,  we  concentrate  on  the 
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decision  aspect-.*  of  the  model.  First,  we  review  the  expected  perfor¬ 
mance  for  the  normative  decison  model  for  various  decision  objectives. 

At  any  given  SNR,  all  the  objectives  proposed  in  this  paper  yield  the 
same  strategy  based  on  c  LR  decision  rule,  as  has  been  noted  before 
(Green  and  Sweta,  1966).  We  show,  furthermore,  that  for  the  objectives 
considered,  the  LR  criterion  level  remains  constant  as  the  SNR  is  varied 
unless  the  Neyman-Pearson  objective  is  employed  by  the  "observer". 

We  propose  a  model  for  decision  behavior  in  which  the  observer  la 
presumed  to  perform  the  optimal  processing  ualns  subjective  rather  than 
objective  distributions,  as  is  usually  the  care.  This  approach  is 
analagous  to  the  "misperception",  as  opposed  to  the  "mlsaggregatlon", 
explanation  of  the  conservatism  in  decision  makers'  behavior  (Rapo- 
port  and  Wallsten,  1972).  Bayes'  Rule  is  used  correctly,  but  on  sub¬ 
jective  rather  than  objective  distributions.  Wheeler  and  Beach  (1968) 
and  Peterson,  DuCharme  and  Edwards  (1968)  measured  subjective  distri¬ 
butions  and  found  better  predictions  of  probability  updating  or  re¬ 
visions  with  these  than  if  they  had  used  the  theoretical  or  objective 
distributions.  Results  of  a  visual  discrimination  experiment  are  pre¬ 
sented  that  are  consistent  with  the  notion  that  people  make  decisions 
on  the  basis  of  subjective  distributions  that  do  not  coincide  with  the 
true  or  objective  stimulus  distributions.  Two  possible  explanations 
for  the  experimental  results  are  discussed  in  terms  of  the  general  decision 
model  presented  here,  one  that  involves  the  use  of  a  subjective  Neyman- 
Pearson  decision  strategy  and  another  that  lmplys  the  breakdown  of  the 
Subjective  Expected  Utility  (SEU)  principle.  One  unequivocal  finding  is 
that  for  experimental  situations  in  which  signal  strength  is  allowed  to 
vary  from  trlal-to-trlal,  decisions  are  not  made  on  the  basis  of  a  con¬ 
stant  likelihood  ratio  criterion. 
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A  MODEL  FOR  DECISION  BEHAVIOR  WITH  CHANGING  SIGNAL  STRENGTHS 


In  this  section  we  develop  a  descriptive  model  for  decision  behavior 
of  observers  in  a  detection  or  recognition  task.  The  first  hypothesis 
is  the  familiar  one  for  the  continuous  sensory  threshold  models. 
Assumptions  of  the  model 

Al.  There  exists  a  unidimensional  psychological  continuum,  X, 
on  which  the  realization  of  any  stimulus  is  described  by  a  point, 
x.  The  distributions  of  these  realizations  over  the  ensemble 
of  stimulus  presentations  of  m  stimulus  pairs  {S^S^,  i#l,...,m} 
are  represented  by  the  conditional  probability  density  functions 
{pCxIS-jKpUlSi)  i  -  1, •  •  •  »m}  . 

The  log  likelihood  ratio  (LLR)  for  these  ensemble  distributions  is: 

ptels^ 

X.(x)  ■  In -  i  »  1,  ‘  *  ,m  (1) 

pOOSj) 

A2.  We  assume  the  existence  of  subjective  uncertainties  which  are 
represented  here  by  the  intermediate  construct  of  subjective  prob¬ 
ability  densities  {p8(x  S^),p8(x  5^,  i*l,  *  *  *  ,m}  with  the  corres¬ 
ponding  LLR: 

P8(x|si) 

X±  (x)  -  In - i  -  1,  •  •  •  ,m  (2) 

P8U|S1) 

A3.  A  total  of  n  ordered  category  responses  {Rj,  j«l,***,n}  are 
available,  and  for  the  i^  stimulus  pair,  its  j^  response  is  chosen 
if: 

xi800£  xi,j  Rj  (3) 

where  X^8j  is  the  criterion  level  at  or  below  which  X^s(x)  leads  to 
a  repponse  R^  or  R£  ...  or  Rn  for  stimulus  pair  i. 
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A4.  The  observer  changes  his  criterion  levels  in  response  to  different 
stimuli  in  order  to  satisfy  a  decision  objective  in  the  same  manner 
cs  would  an  objective  decision  maker,  but  subjective,  rather  than 
objective  distributions  are  used  in  this  process. 

As  mentioned  before,  the  first  assumption  concerning  the  mapping  of  a 
stimulus  to  the  psychological  continuum  is  the  basic  one  for  all  sensory 
continuum  models.  It  is  important  to  realize  that  the  variability  in  re¬ 
sponses  over  the  ensemble  of  trials  is  attributed  to  the  ensemble  distri¬ 
butions  of  these  points  (neglecting  any  criterion  variability) .  In  sub¬ 
sequent  discussions,  we  will  refer  to  these  as  the  objective  distributions, 
since  knowledge  of  these  distributions  is  necessary  for  a  decision  maker 
to  optimize  performance.  The  objective  distributions  are  typically  con¬ 
sidered  to  be  determined  by  external  experimental  constraints  (e.g.  choice 
of  signals),  sensory  processing  (e.g.  the  "critical  band"  processing  con¬ 
cept  in  audition),  and/or  memory  processing. 

The  observer's  ultimate  representations  of  these  distributions  is 
explicitly  recognlrvd  here  as  being  different  from  the  objective  distri¬ 
butions  (A2) .  The  traditional  statements  of  TSD  assume  that  it  is  the 
objective  distributions  that  are  learned  by  the  observer  in  a  psychophysical 
experiment  during  the  training  periods.  We  do  not  make  that  restriction 
here,  and  point  to  the  work  of  Lee  (1963)  in  which  he  showed  distinct  dif¬ 
ferences  between  inferred  values  of  subjective  and  objective  LLR  for  ex¬ 
ternally  distributed  stimuli.  In  particular,  Lee  found  that  the  subjec¬ 
tive  LLR  can  be  monotonic  for  unequal-variance  Gaussian  distributions 
when  the  objective  LLR  is  not.  To  the  extent  that  this  holds  true  for 


Internally  distributed  stimuli,  using  subjective  rather  than  ob¬ 
jective  LR's  for  response  determination  (A3)  removes  the  bothersome 
aspect  of  nonmonotonic  LR's  that  are  characteristic  of  conventional  TSD. 

Assumption  A4  has  a  substantial  impact  on  the  prediction  of  observed 
performance  over  the  ensemble  of  trials.  If  an  observer  is  presumed  to 
be  extremallzlng  any  objective  function  other  than  the  Neyman-Pearson, 
the  value  of  subjective  LR  at  the  criterion  point  should  remain  constant  over 
all  stimulus  strengths.  There  is  a  large  class  of  subjective  and  objective 
distributions  which  would  admit  a  one-to-one  mapping  from  subjective  LR 
to  objective  LR;  experimental  evidence  suggests  that  this  is  usually  sat¬ 
isfied  in  practice  (e.g.  Wheeler  and  Beach,  1968;  Peterson,  et  al.,1968). 

In  particular,  distributions  which  lead  to  a  monotone  nondecreablng  Xs (x) 
and  any  X(x)  will  have  such  a  property. 

ENSEMBLE  PERFORMANCE 

In  this  section  we  derive  the  analytical  expressions  for  model  parameters 
in  terms  of  measures  of  performance  over  the  ensemble  of  trials  for  equal- 
variance  stimulus  pairs.  These  relationships  are  used  in  estimating  para¬ 
meters  from  observed  data. 

Objective  distributions 

The  objective  distributions  describe  the  variability  on  the  psycho¬ 
logical  continuum  from  trial  to  trial.  Each  stimulus  is  presumed  to  give 
rise  to  a  distribution  p(x|*)  and  it  is  further  assumed  that  each  real¬ 
ization  is  independent  of  all  others. 

Denote  by  P^  j  and  P?A  ^  j  the  "hit"  and  "false  alarm"  probabilities 
for  stimulus  pair  i  with  respect  to  criterion  level  j,  i.e: 
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PH,l,j  ■  P(R1  or  R2  «  •"  01  Rjlsi)  ■  P(X1‘(»1X1‘J|S1J 

,  (A) 

PFA,i,j  “  P(R1  or  R2  or  "*  or  Rjl5J  "  P(Xi8<x>lxi®Jl§i) 

When  the  underlying  objective  distributions  are  Gaussian,  these  expressions 
seduce  to  a  particularly  simple  form: 


PH,i,j  “*<zH,i,j> 
PpA,i,j“*(*FA,i,j) 


ZH,i,J 


z 


pA*i,j" 


(5) 


(6) 


where  *  Is  the  distribution  funntion  for  unit  normal  variables,  and  the 
z's  are  the  correpsondlng  unit  deviates.  The  LLR  criterion  levels,  X. 

J 

are  those  observed  from  an  objective  decision  maker  operating  on  two 
equal-variance  Gaussian  distributions  with  a  SNR  of  d^'.  These  values  can 
be  estimated  from  the  observed  proportion  of  hits  and  false  alarms  at  each 
SNR.  It  is  the  model  of  the  decisions  based  on  subjective  LLR  that  con¬ 
strains  the  objective  LLR  criterion  levels  between  SNR  levels  and  prevents 
these  X^  j  from  being  completely  free  parameters.  Figure  1  contains  theo¬ 
retical  curves  of  constant  d’  (ROC  curves)  and  curves  of  constant  X (isobias 
curves).  Thus  if  an  observer  were  operating  at  constant  (objective)  LLR, 
the  points  on  the  P(Hlt)-P(FA)  plane  would  lie  along  the  corresponding  con¬ 
stant-!  curves  ao  d*  is  varied  from  0  to  ». 


Subjective  Distributions. 

Constant  Subjective  LR.  As  described  above,  many  of  the  decision 
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objectives  lead  to  constant  LR  criterion  levels  as  the  distributions 
(SNR's)  are  changed.  Assumption  A4  leads  to  the  conclusion  that  the 
observer  will  use  constant  subjeetive  LR  criteria  over  all  SNR's.  To 
the  extent  that  a  given  subjective  LR  corresponds  to  a  unique  value  of 
objective  LR,  this  behavior  over  the  ensemble  of  trials  will  be  Identical 
to  an  observer  using  constant  objective  LR  criteria  on  the  objective 
distributions.  Morn  specifically,  if  the  objective  LLR  is  functionally 
related  to  subjective  LLR  by: 

X(x)  -  g(x8(x)}  (7) 


and  if  g(*)  is  a  one-to-one  mapping,  then  a  constant  subjective  LLR  for 
criterion  level,  j, 

X  8  =  X®  all  i  (8) 

J  >  J 

leads  to  a  constant  objective  LLR, 


Xlfj  -  Xj  -  g(Xj®)  all  i 


(9) 


This  condition  will  hold  under  a  wide  class  of  objective  and  subjective 
distributions,  although  the  empirical  evidence  suggests  that  a  simple 
linear  relation  in  (7)  is  a  good  approximation  in  many  situations  (r8«. 
poport  and  Wallsten,  1972).  Thus,  the  expressions  for  observed  unit 
deviates  (6)  become, 


ZH,i,j  " 


ZFA,i,j 


g<  V) 
- + 


8<  *  “) 

- J__  + 


(10) 
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Neyman-Pearson  Ob,1  ective .  The  development  for  subjective  Ney- 


man-Pearaon  decisions  requires  a  more  detailed  structure  than  that  for 
constant  subjective  LR.  In  addition  to  the  assumption  of  Gaussian  objec¬ 
tive  distttbutions,  we  further  assume  that: 

a.  the  subjective  distributions  are  normal,  and 

b.  Xs (x)  -  b*X(x)  (11) 

The  constant, b,  relating  subjective  LLR  to  objective  LLR  is  the  so-called 
accuracy  ratio,  the  validity  of  this  expression  as  a  first  approximation 
has  been  verified  under  a  wide  range  of  experimental  conditions  (Rapo- 
port  and  Wallsten,  1972). 

The  ensemble  performance  of  an  observer  using  a  subjective  Neyman- 
fearson  rule  for  the  jth  criterion  level  will  be  constrained  by  constant 
(subjective)  probability  of  false  alarm,  or,  equivalently, 


X  ®  <*«8 

z®  -  const  «  — - 

FA.j  d*s  2 


(12) 


where  the  superscript,  s,  denotes  subjective  values.  For  zero-mean 
normal  distributions  it  is  well  known  that  (Green  and  Swets,  1966): 


X(x)  ■  d' *x 


(13) 


which  leads  to  an  expression  for  subjective-SNR,  d,s, 
d’8,x  -  Xs (x)  -  b*X(x)  -  b'd*  *x 

and  thus,  d'8  ■  b*d’  (14) 

Substituting  (14)  and  (13)  into  (12),  solving  for  X^  j,  in  turn,  and 
substituting  the  result  into  (6)  provides  an  expression  for  the  unit 
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deviates  over  the  ensemble  of  trials 


V 

z  ■  za  + - •  (l+b) 

H,i,j  FA.j  2  U 


FA 


.u-  ’n,i  -  “  ,(1-b) 


(15) 


la  recognition  and  discrimination  tasks,  the  distinction  between  "noise" 
and  "signal  plus  noise"  becomes  arbitrary  and  so  operation  at  a  constant 
probability  of  hit  may  be  expected.  The  corresponding  expressions  are, 


ZFA,i,j“ 


(16) 


This  family  of  curves  describing  the  ensemble  performance  has  a  particularly 
simple  form  in  the  unit-deviate  plane  (Figure  2);  the  loci  of  observations 
lie  on  straight  lines  with  slope  of  (l+b)/(b-l)  or  (b-l)/(l+b),  and 


reduce-  to  the  expected  result  when  the  objective  and  subjective  distribu¬ 
tions  are  equal  (b*l) .  The  corresponding  loci  in  the  P (Hit )-P (False  Alarm) 
plane  are  shown  in  Figure  3  for  representative  values  of  b.  Th?  most 
striking  characteristic  Is  that  for  any  b<l  the  limiting  values  as 
d'-*09  of  the  observed  probability  of  false  alarm  is  zero;  when  the  prob¬ 
ability  of  hit  Is  subjectively  constant,  Its  (objective)  limiting  value  Is  1. 


Degrees  of  Freedom:  Positive  or  Negative? 

With  the  introduction  of  the  subjective  basis  for  decisions  and 


subsequent  analysis  for  ensemble  performance,  one  might  wonder  whether 
there  are  so  many  parameters  that  the  model  loses  any  significance  it 
might  have  had.  In  reality,  we  have  only  added  one  new  parameter  and 
placed  new  interpretations  on  old  parameters.  Thus  the  model  is  quite 
parsimonious  as  can  be  seen  in  the  accompanying  table  (Table  1)  which 
was  prepared  for  m  pairs  of  equal -variance  Gaussian  stimuli  (m-SNR's) 

and  an  n-category  rating  scale.  As  an  example,  using  2  and  3  SNR's  with 
a  4  category  scale  yields  6  and  11  degrees  of  freedom,  respectively. 

VISUAL  DISCRIMINATION  WITH  RANDOMLY  VARYING  SNR 

Method 

Apparatus .  A  visual  discrimination  task  was  presented  on  a  17-inch  CRT 
in  the  form  of  pairs  of  quarter-inch  circles.  Zen  pairs  of  circles, 
at  five  distances  from  a  cursor,  constituted  the  entire  stimulus  set, 
shown  in  Figure  4.  The  observers'  task  was  to  indicate  whether  the 
pair  of  circles  was  to  the  right  or  left  of  a  vertical  line  passing 

through  the  small  vertical  cursor  near  the  bottom  of  the  screen.  This 
provided  five  SNR's  since  the  discrimination  is  easier  for  circles 
closer  to  the  cursor  than  for  those  farther  away.  Subjects  indicated 
their  response  by  pushing  one  of  3  buttons  corresponding  to  "think  left", 
"don't  know",  and  "think  right".  An  odd  number  of  categori&s  was  used 
to  avoid  the  central  criterion;  we  have  results  similar  to  those  re- 
proted  here  with  an  even  number  of  categories. 

Subjects.  Six  graduate  students  participated  as  observers  on  a  volun¬ 
tary  basis  in  four  half-hour  sessions. 

Procedure .  A  standard  set  of  instructions  were  read  to  the  subjects 
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describing  the  experimental  setup,  Informing  them  of  equlprobable 
right  and  left  presentations  and  the  scoring  method  displayed  to  them  at 
the  end  of  each  session.  Three  points  were  given  for  a  correct  response, 
minus  three  points  for  an  Incorrect  response,  and  zero  for  "don't  know". 

A  stimulus  (e.g.  a  pair  of  circles)  appeared  for  4  seconds  and  the  screen 
was  then  blanked  for  a  2-second  response  Interval.  Feedback  after  each 
trial  was  not  given. 

After  10  minutes  of  practice,  subjects  began  the  first  of  four 
half  hour  sessions  of  300  presentations  of  the  stimuli  in  random  order. 

The  data  for  all  sessions  were  pooled,  resulting  in  an  average  of  120 
presentations  per  stimulus  or  240  presentations  per  SNR  for  each  subject. 
Results. 

Maximum  likelihood  estimates  of  model  parameters  were  made 
for  each  subject  in  several  ways.  First  the  two  LLR  criterion  levels 
(*!_,  *2>  and  equal-variance  d'  values  were  estimated  for  each  SNR. 

(Table  2).  Three  of  these  parameter  sets  were  not  attempted  because 

O 

of  extreme  observations  (e.g.  no  errors)  at  the  highest  SNR.  A  x 
goodness  of  fit  test  did  not  indicate  a  rejection  of  the  equal-variance 
Gaussian  hypothesis  for  any  of  the  27  parameter  sets  even  though  d' 
values  ranged  from  .15  to  3.89. 

A  more  sophisticated  routine  (.Curry,  1974)  was  used  to  obtain  the  ML 
estimates  of  the  global  model,  i.e.,  the  simultaneous  estimation  of 
5  d'  values  and  the  two  (or  three)  parameters  describing  the  decision 
rule.  Not  all  combinations  of  decision  strategies  were  evaluated  since 
inspection  of  the  raw  data  on  the  P(Hit)-P<False  Alarm)  plane  ruled 
out  many  as  being  unreasonable.  However,  a  constant  LR  strategy  was 


tried  for  each  subjedt  to  provide  information  regarding  this  hypothesis. 
We  have  included  the  results  for  a  mixed  strategy,  where  the  first  cri¬ 
terion  level  is  assumed  to  be  a  constant  LR  criterion  while  the  second 
criterion  level  is  obtained  via  application  of  a  subjective  Neyman- 
Pearson  rule. 

The  values  of  the  ML  estimates  for  the  various  decision  strat¬ 
egies  are  summarized  in  Table  3.  The  degrees  of  freedom  are  not  the 
same  because  data  were  ppoled  to  obtain  cells  with  expected  frequencies 

greater  than  4.  We  feel  that  this  constitutes  a  powerful  test  of  the 

2 

model,  since  one  and  only  one  strategy  was  not  rejected  by  the  x  test 

for  five  of  the  six  subjects.  Examination  of  Table  3  (or  figures  9 

and  10  which  follow)  shows  that  the  data  are  best  explained  by  mixed 

decision  strategies  for  subjects  5  and  6,  i.e.  a  constant  LR  criterion 

for  one  threshold  and  a  subjective  Neyman-Pearson  criterion  for  the 

o 

other  threshold  yield  the  minimum  1  value.  This,  we  feel,  is  due 
to  the  assumed  linear  relation  between  subjective  and  objective  likeli¬ 
hood  ratios,  rather  than  a  difference  in  strategies.  The  primary  reason 
for  this  is  the  sensitivity  of  P(Hit)-P (False  Alarm)  values  to  LLR  at 
low  d'  (see  Figure  9,  where  a  small  change  in  the  theoretical  LLR  would 
dramatically  change  the  predicted  data  point  at  the  lowest  d'). 

Thus  a  slight  relaxation  of  the  linear  constraint  would  signif¬ 
icantly  lmporve  the  descriptive  power  of  the  model  without  affecting 
its  usefulness.  Deviations  from  linearity  should  be  allowed  in  future 
applications  because  first,  any  calculated  accuracy  ratio  is  sensitive 


to  sampling  variations  at  small  levels  of  LLR,  and  second,  many  subjects 
exhibit  systematic  nonlinear  trends,  with  a  decrease  in  accuracy  ratio 
at  higher  LLR  being  typical  (Peterson,  et  al.,  1968). 

The  ROC  curves  in  Figures  5  through  10  are  the  theoretical  pre¬ 
dictions  from  the  Maximum  Likelihood  estimates  yielding  the  smallest 
value. 


DISCUSSION 

The  strongest  conclusion  to  be  drawn  from  the  experimental  re¬ 
sults  is  that  subjects  operate  with  (objective)  LR  criterion  levels 
that  vary  with  SNR.  Data  similar  in  nature  were  tabulated  in  Klnchla 
and  Smyzer  (1967)  and  we  have  plotted  it  in  the  P(H)-P(FA)  plane  in 
Figure  11  as  further  evidence  of  this  behavior. 

The::e  are  several  explanations  for  these  results.  We  feel  that 
the  response  mode  (an  odd  number  of  categories)  can  be  ruled  out  since 
we  have  obtained  similar  results  with  an  even  number  of  categories, 
and  the  Klnchla  and  Smyzer  data  were  generated  from  binary  responses. 
There  may  be  some  decision  strategy  other  than  the  Neyman-Pearson  rule 
that  we  have  not  considered  which  requires  a  shift  in  LR  criterion 
with  SNR.  For  example,  the  criterion  levels  might  be  fixed  on  the 
sensory  continuum.  This  hypothesis  is,  however,  inconsistent  with  the 
data. 

The  possibility  of  a  drift  in  perceptual  memory  as  a  source  of  the 
criterion  shift  was  suggested  by  Klnchla  and  Smyzer  for  the  auditory 
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Cask  (Figure  lib) ;  they  did  not  discuss  the  criterion  shifts  that  ap¬ 
parently  exist  for  the  visual  task  (Figure  11a).  A  memory  function 
was  not  required  for  the  experiments  reported  here,  and  it  seems  un¬ 
likely  that  the  LLR  criterion  shift  has  a  sensory  basis.  Thus  the  LLR 
change  would  appear  to  be  related  to  decision  processes,  and  this  ap¬ 
pears  to  be  an  alternative  explanation  to  the  results  reported  by 
Klnchla  and  Smyzer  as  well. 

The  most  viable  alternative  to  the  subjective  Neyman-Bearson 
rule  as  an  explanation  of  the  observations  is  a  breakdown  of  the 
Subjectively  Expected  Utility  (SEU)  theory.  Of  the  three  major  as¬ 
sumptions  comprising  the  SEU  model  (Tversky,  1967)  the  Independence 
of  utilities  and  subjective  probabilities  is  critical  in  this  situation. 
When  the  Independence  principle  is  valid,  the  subjective  LLR  criterion 
level  is  determined  by: 


*  •  In 


uoo  -  U01 
ull  -  U10 


(17) 


where  U  is  the  utility  of  responding  hypothesis  1  when  hypothesis  j 
is  actually  true.  It  is  difficult  to  completely  eliminate  the  bhange 
in  utilities  as  the  source  of  variation  without  experimental  evidence 
to  the  contrary.  Although  the  payoff  matrix  has  been  manipulated  to 
alter  criterion  levels  (Green  and  Swets,  1966)  we  are  not  aware  of  any 
utility  measurements  in  a  psychophysical  setting  even  at  one  SNR,  and 
results  for  multiple  SNRs  would  be  required  here. 

In  spite  cf  this  lack  of  data,  we  feel  that  the  change  of  utilities 
with  SNR  (i.e.  the  breakdown  of  the  SEU  model)  is  a  less  satisfactory 
explanation  than  the  subjective  Neyman-Pearson  rule  for  the  following 


, 
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reasons.  Wallsten  (7970),  in  explaining  when  the  SEU  model  has  been 
found  to  be  valid,  summarized  the  experimental  efforts  by  suggesting 
that  the  SEU  model  is  more  appropriate  in  "simple"  rather  than  "complex" 
decision  situations.  Although  the  line  of  demarcation  between  "simple" 
and  "copplex"  decisions  must  necessarily  be  a  fuzzy  one,  the  decisions 
reported  here  must  surely  lie  toward  the  "simple"  end  of  the  continuum. 
Furthermore,  unusual  changes  in  utilities  would  be  necessary  to  explain 
the  observed  results.  An  examination  of  the  objective  LLR  criterion 
levels  from  the  Maximum  Likelihood  estimation  procedure  shows  non-monotonic 
behavior  of  criterion  level  with  SNR,  and  even  changes  of  sign.  Although 
this  is  consistent  with  a  Neyman-Pearson  rule,  the  utilities  would  have 
to  change  in  a  manner  such  that: 

(1)  a  "right"  (or  "left")  response  is  preferred  at  the  longer  dis¬ 
tances  , 

(2)  the  utilities  change  to  strengthen  this  preference  for  "right" 
or  "left"  at  intermediate  distances,  and 

(3)  the  utilities  change  again  to  bias  responses  in  the  opposite 
direction  at  nearer  distances. 

In  summary,  we  have  examined  the  decision  behavior  with  multiple 
signal-to-nolse  ratio  stimuli  and  proposed  a  quantitative  model  in 
which  subjective  (rather  than  objective)  distributions  play  a  key  role. 

The  model  predicts  that  the  ensemble  performance  of  an  observer  should  lie  along 
a  constant  (objective)  LR  curve  unless  he  is  using  the  Neyman-Pearson 
objective.  The  experimental  evidence  from  a  visual  discrimination  task 
certainly  shows  that  the  LR  criterion  level  char, change  with  SNR.  The 
most  plausible  alternative  explanation  to  a  subjective  Neyman-Pearson 
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rule  is  the  breakdown  of  the  SEU  model.  The  experimental  evidence 
suggests  that  this  Is  unlikely  In  the  "simple"  decision  detting 
used  here,  and  moreover  the  required  utility  changes  would  be  most 
unusual  to  explain  the  observations.  The  constant  subjective  LR  and 
subjective  Neyman-Pearson  rules  describe  the  data  well  on  the  local 


and  global  levels. 
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Table  1 


Parameter  Sunmary  for  m  Pairs  of  Equal-Variance 
Gauaalan  Stimuli  (m  SNRs) 


Model  Parameters  to  be  Estimated 

(number) 


Degrees  ®fa 
Freedom 


Constant 

Objective  LLR 

di 

(m),  Xj  (n-1) 

(2m-l) (n-1)  -  m 

Objective 

Neyman- Pears on 

di 

(m),  (n-1) 

(2m-l) (n-1)  -  m 

Constant 
Subjective  LLR 

di 

(”)>  g(x!) 

(n-1) 

(2m-l)(n-l)  -  m 

Subjective 

Neyman-Pearson 

di 

(m)  ,  b,  z‘?k>i 

(n-1) 

(2m-l) (n-1)  -  (m+1) 

Mixed 

Strategy 

di 

(”>  •  b’  ZFA,J 

or  g(Xa) 

(2m-l) (n-1)  -  (m+1) 

» J 

(n-1) 


g 

Degrees  of  freedom  are  the  number  of  Independent  equations,  2m(n-l), 
minus  the  number  of  parameters. 
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Table  2  (continued) 


Subject  SNR  *  X2  d’ 


Table  3 


Goodness  of  Fit  Tests  of  ML  Estimates  (5  SNRs) 


X2(df) 


Constant 

LLR 

Objective 

Neyman-Pearson 

Subjective 

Neyman-Pearson 

Mixed 

Strategies 

6.3(7) 

**  a 

29.8(6) 

** 

19.6(5) 

11.0(8) 

33.3(11)** 

** 

20.9(8) 

— 

** 

39.8(10) 

— 

16.7(9) 

27.7(8) 

70.0(13)** 

$9.6(12)** 

28.3(11)** 

28.7(H)1 

68.2(13)** 

— 

— 

20.8(12) 

FIGURE  CAPTIONS 


Figure  1 


Figure  2 


Figure  3 


Figure  4 


Figure  5 


Figure  6 
Figure  7 

Figure  8 


Theoretical  curves  In  the  P(hlt)-P(FA)  plane  for  equal-variance 
normal  distributions.  Solid  lines  are  Isosensltlvlty  curves 
(d*  ■  .5,  1.,  2.).  Dotted  lines  are  lsoblas  curves 
( | X |  ■  .1,  .5,  1.).  Positive  values  of  X  In  the  upper  half-plane, 
Increasing  toward  the  top.  Negative  values  of  X  In  the  left 
half-plane,  decreasing  toward  the  left. 

Theoretical  curves  of  unit  deviates  for  observed  P(hit)-P(FA) 
when  the  observer  uses  a  subjective  Neyman-Pe arson  decision 
rule.  The  subjective  distributions  are  assumed  normal,  and  b 
Is  the  ratio  of  subjective  to  objective  LLR. 

Theoretical  curves  of  P(Hit)-P(FA)  using  subjective  Neyman- 
Pe arson  decision  rules.  The  straight  dashed  lines  are  for 
b  -  1  (subjective  LLR  equals  objective  LLR)  i  the  other  loci 
are  for  b  «  .75  and  .25. 

Stimuli  for  the  visual  discrimination  task  showing  both  hypotheses 
(left  and  right)  and  the  five  SNRs  (distances  from  the  cursor). 

Not  drawn  to  scale. 

F(Hlt)-P(FA)  for  observer  1  with  constant  LLR  decision  rules 

(X  -  -.93,  .17).  Theoretical  curves  are  the  ML  estimates 
2 

yielding  minimum  x  values. 

P(Hit)-P(FA)  for  observer  2  with  constant  LLR  rules  (X  ■  -.86,  .58) 
P(Hit)-P(FA)  for  observer  3  with  subjective  Neyman-Pearson 
decision  rules  (b  -  .29). 

P(Hit)-P(FA)  for  observer  4  with  subjective  Neyman-Pearson 
decision  rules  (b  ■  .66). 
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Figure  Ceptlona  (Continued) 


Figure  9  P(Hit)-P(FA)  for  observer  5  with  constant  LLR  and  subjective 
Neyman-Pearson  decision  rules  (X  -  -.22,  b  -  .25). 

Figure  10  P(Hlt)-P(FA)  for  observer  6  with  constant  LLR  and  subjective 
Neyman-Pe arson  decision  rules  (X  -  -.26,  b  ■  .22) 

Figure  11  P(Hlt)-P(FA)  performance  In  perceptual  memory  tasks  (data 
from  Kinchla  and  Smyzar,  1967).  a)  Visual  b)  Auditory 
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A  METHOD  FOR  UNBIASED  PARAMETER  ESTIMATION  BY  MEANS  OF  THE 
EQUATION  ERROR  INPUT  COVARIANCE 
by 

S.J.  .MERHAV  and  E.  GABAY 
Department  of  Aeronautical  Engineering 
Technion  -  Israel  Institute  of  Technology, 

Haifa,  Israel. 


ABSTRACT 

A  new  method  for  obtaining  a  unique  and  unbiased  estimate  of  an 
r-dimensional  parameter  vector  in  open  or  closed  loop  linear  systems  in 
the  presence  of  noise  is  described*  The  method  is  based  on  the  "equation 
error"  and  is  presented  in  continuous  time.  Instead  of  the  classical  least 
squares  approach,  the  equation  error  is  correlated  with  the  input  and  the 
covariance  is  equated  to  zero.  The  resulting  single  linear  equation  in  the 
r  unknown  parameters  provides  a  necessary  condition  for  their  unique  identi¬ 
fication.  From  it,  r  -  1  additional  independent  equations  are  generated. 
The  resulting  r  linear  equations  provide  the  unbiased  estimate  of  the  para¬ 
meter  vector.  The  method  does  not  require  the  identification  of  the  noise 
statistics  and  no  precise  knowledge  of  the  form  and  order  of  the  system  is 
required.  Implementation  is  indicated  in  hybrid  analog-digital  form.  The 
method  is  illustrated  by  numerical  examples. 
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1.  INTRODUCTION 


Most  currant  methods  for  identifying  linear  dynamical  systems  are  based 
on  least  squares  estimation  [1],  The  fundamental  idea  is  to  generate  an 
error  between  a  "model"  and  the  system  to  be  identified  and  to  minimize  a 
quadratic  function  of  this  error  with  respect  to  a  parameter  vector,  the 
solution  of  which  constitutes  the  "least  squares  estimate".  The  attractive 
property  of  this  approach,  as  manifested  In  the  "equation  error"  method  [2], 

Is  that  the  error  is  linearly  related  to  the  parameter  vector.  This  property 
guarantees  that  the  least  squares  estimate  is  unique.  In  other  methods,  such 
as  the  parallel  model  error  [1],  this  relation  is  not  linear  and,  in  general, 
the  parameter  estimate  is  not  unique »  However,  a  severe  disadvantage  of  the 
least  squares  approach  is,  that  in  the  presence  of  noise  at  the  system  input 
or  output,  the  estimate  of  the  parameter  vector  becomes  biased  [3] .  This  bias 
can  become  extremely  large  even  for  apparently  low  noise  levels,  especially  if 
the  system  to  be  identified  is  of  comparatively  high  order  [4] .  Identification 
becomes  particularly  difficult  if  the  system  operates  in  a  closed  loop  in  which 
the  circulation  of  noise  components  creates  "correlated  residuals"  leading  to 
bias.  In  recent  years  several  methods  have  been  developed  which  remove  this 
noise-due  bias.  The  best  known  of  these  are  the  "generalized  least  squares" 

[5]  and  the  "instrumental  variable"  method  [6].  Essentially,  these  are 
extensions  of  the  classical  least  squares  method.  Examples  to  which  they  have 
been  applied  demonstrate  that  the  bias  can  be  eliminated.  This,  however,  Is 
achieved  at  the  expense  of  two  factors: 

1.  Considerable  complication  of  the  algorithm  and  increase 


In  computation  time 


2. 


Loss  of  the  fundamental  property  of  uniqueness  of  the 
estimate  which  exists  in  classical  least  squares  [1} . 


In  this  paper,  a  new  method  for  parameter  estimation  is  described.  It  is 
based  on  the  "equation  error"  and  as  such  it  retains  the  fundamental  linear 
relationship  with  the  parameter  vector.  However,  instead  of  minimizing  a 
quadratic  measure  of  this  error,  it  is  correlated  with  the  system  input. 

Equating  the  equation  error  -  input  -  covariance  to  zero,  yields  a  necessary 
condition  from  which  complete  identification  of  the  parameter  vector  of  a  system 
in  a  closed  loop  and  in  the  presence  of  noise  is  achieved.  The  method,  called 
"Equation-Error-Input-Covariance"  method  (EEIC)  has  the  following  properties] 

1.  Unbiased  estimate  both  in  open  and  closed  loop. 

2.  The  estimate  is  unique. 

3.  Identification  of  the  noise  statistics  is  not  required. 

4.  The  assumed  model  may  be  of  higher  order  than  the  real 
system.  The  excess  parameters  are  forced  to  zero  so  that 
both  form,  order  and  parameters  are  simultaneously 
identified. 

5.  On-line  identification  is  possible  if  a  recursive  algorithm 
is  applied. 

2.  NOTATION  AND  BACKGROUND 

Let  s”  be  a  linear  single-input-single-output  time  invariant  system,  m 
and  n  are  the  highest  powers  in  the  numerator  and  denominator  respectively. 
These  are  defined  by; 


m 


N(p,b)  -  l  b.p 

i«o 


n 


D(p,a)  »  1  +  l  a.p 

j-1  3 


j 


f 


(1) 


A  d^/dt^ .  S*  may  be  a  closed  loop  system  In  which  G(p)  Is  the  dynamic 

m  n 

element  to  be  identified  and  L(p)  is  the  loop  closure.  x(t)  is  a  random 

stationary  input  and  y(t)  is  the  corresponding  system  output.  Let 

H(p){Col[p°,p1,...,ph]}  and  H(p) {Collp0,?1, . . . iP*) }  be  vectors  of  linear 

operators  on  x(t)  and  y(t)  respectively.  As  shown  in  [7] ,  l  >  n  and 

h  >  m  is  permitted  with  the  formulation  of  Eq.  (1) .  This  has  the  advantage 

in 

that  no  precise  a  priori  assumptions  regarding  the  form  and  order  of  are 

required.  The  role  of  the  linear  operator  H(p)  is  usually  to  avoid  pure 
differentiations  [2]  but  its  specific  task  in  this  paper  will  become  clear 
later.  Let  a  and  j3  be  parameters  corresponding  to  a  and  b  .  On 
forming : 


R(p,8)  A  H(p)  E  ^p 
i-o 


(2) 


J, 


Q(p,o)  A  H(p)  (1  +  E  a  pJ)  f; 

j-1  3  J 

the  noiseless  "equation  error"  [2]  e(t)  is  given  by 
e (t)  -  Q(p,a)y(t)  -  R(p,e.)x(t) 


(3) 


In  practical  systems  the  output  y(t)  is  usually  contaminated  by  noise  n^(t) 
which  is  zero  mean  and  is  uncorrelated  with  x(t).  A  block  diagram  is  given 
in  Fig.  1. 

The  input-output  relations  in  terms  of  Laplace  transforms  are: 
y(s)  -  T(s)x(s)+n(s)  (4) 
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where 


and 


T(a) 


n(a) 


G  (■) 


1  +  L (a)G (a) 


n^(a) 


1  +  L(a)G(a) 


(5) 


16) 


The  filtered  atate  variables  in  accordance  with  Eq.  (3)  are 


A  H(p)px,  i  -  0,  l,...,h 

Yj  +  nj  ■  H<p)pj (y+n>*  3  ■  i 


(7) 


The  complete  filtered  r  ■  l  +  h  +  1  dimensional  state  vector  is  defined  by: 


w  +  n  A  Colt (yj+n^) (y^+n^) (8) 

With  these  notations  the  equation  error  is  given  by: 

^  m  /Q\ 

e  ■  W  1  WV  1  M±  ■  y +«  L 

°  j«l  3  3  2  i-o  1  1  °  ° 

where  r  in  l+h+1  ■  r  dimensional  parameter  vector  given  by 

r  A  Col(a1#..,a4,  -  30»«..,-  3^)  (10) 

and  yo  ■  y,  n  ■  n.  For  n(t)  =  0,  if  all  components  of  w  are  linearly 
independent,  e(t)  =0  is  necessary  and  sufficient  for  the  complete  identifica¬ 
tion  of  c  A  Col  (a  ,b) .  On  minimising  the  cost  function  I  -  (1/2) E (e2) , 
where  E(e  )  is  the  expectation  of  an  ensemble  of  functions  e  (t) ,  the 

A 

solution  of  the  least  squares  estimate  of  £,  £  is  found  to  be  [3] , 

£  —(A  +  An)’1(u  +  (11) 

where : 
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A  E  (w  w  ) 

A  A  E (n  nT) 
n  *  — .  — . 

U  A  E (YqW) 
u  A  E(n  n) 


The  true  unbiased  least  squares  estimate  T  of  c  A  Col(a,b)  is: 

«-o  -  ■  —  — 

A  _  -1  - 

r  —  -a  u 


(12) 


(13) 


A  major  problem  in  process  parameter  estimation  is  the  elimination  of  the  bias 

AAA 

b  •  r  -  r  .  Methods  which  achieve  this  are  referenced  in  (1].  The  best  known, 

—  —  "O 

[5] ,  [6]  retain  some  of  the  fundamental  properties  of  least  squares  but  in 
general,  convergence  to  the  unique  estimate  r^z-A  1  u  cannot  be  proven. 

In  this  paper  a  new  method,  called  the  "Equation  Error  -  Input  Covariance" 

(EEIC)  method  is  presented.  Its  basic  property  is  that  it  provides  a  unique 
and  unbiased  parameter  estimate  of  c.  Unlike  the  above  mentioned  extended 
least  squares  methods  in  which  the  bias  is  eliminated  by  auxiliary  procedures, 
its  existence  is  prevented  at  the  outset  by  virtue  of  the  basic  principle 
involved. 

3.  THE  EEIC  METHOD 

In  accordance  with  Eqs.  (3)  -  (6)  the  equation  error  is  given  by: 

e  (t)  -  T(p)Q(p,o)x(t)  -  R(p,£)x(t)+Q(p,o)n(t)  (14) 

Multiplying  e(t)  by  x(t)  and  taking  the  expectation  of  the  product,  one  has: 

E[x(t)e(t)  ]  =  E{x2(t)  (T(p)Q(p,a)  -  R(p,6)]}  +  E[x(t)n(t)Q(p,a)  ]  = 

“tT^CfPfa)  -  R(p,B_)  ]E[x2(t)  ]  +  Q(p,o)E[x(t)n(t)  ] 

(15) 
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Since  n(t)  and  x(t)  are  assumed  to  be  uncorrelated  (Sec.  2),  the  second  term 

2 

in  Eg.  (15)  varnishes.  Since  E[x  (t) )  /  0,  the  first  term  in  Eg.  (15)  can  vanish 
if,  and  only  if 

T(p)Q(p,o)  -  R(p,£)  =0  (16) 

Since  y(t)/x(t)  A  T(p),  it  follows  from  Eg.  (3),  that  this  is  the  condition  for 
the  vanishing  of  the  "noiseless"  eguation  error  e (t) . 

In  accordance  with  Egs,  (1)  and  (10)  ,  Eg.  (16)  is  fulfilled  if,  and  only 
if,  ®.  ■  £.  and  £  ■  -b  so  that  from  Eg.  (15)  the  condition  necessary  for  the 
complete  identification  of  £  A  Col  (a,b)  is: 

E[x(t)e(t)  ]  -  0  (17) 

Eg.  (17)  is  one  eguation  in  the  r  unknowns  which  constitute  the  r-dimensional 

parameter  vector  £.  Substituting  e (t)  from  Eg.  (9)  and  by  virtue  of  Eg.  (15) 

disregarding  the  noise  terms,  one  has: 

E [x (y  +  wTr)]  -  0  (18) 

o  —  — 

or : 

E[x  w1)T1  +  E[x  w2]T2+,. . ,/+E[x  Wr]Tr  ■  -  E[x  yQ]  (19) 

Conseguently  the  solution  for  £  lies  on  the  r-dimensional  hyperplane  defined 

A 

by  Eg.  (19) .  In  order  to  determine  the  point  which  is  the  solution  £  - 
Eg.  (19)  must  be  supplemented  by  additional  r  -  1  independent  linear  eguations 
in  r  ,...,r  .  The  generation  of  these  additional  r  -  1  eguations  is  a 
straightforward  matter  if  one  recalls  that  the  linear  operator  H(p)  in  Egs.  (2) 
and  therefore  in  Eg.  (3),  is,  in  principle  arbitrary.  One  can,  therefore,  form 
a  linearly  independent  set,  (p) ,  H2 (p) , . . ,H  (p)  which  operate  on  the  system 
output  y (t)  and  in  accordance  with  Egs,  (7) ,  (0)  set  up  the  corresponding  set  of 
eguations  as  follows : 


M  P  k  *1  k.  ft 


45 


E[X  w113r1  +  E[x  w12lr2  +»..•»+  E[x  wlr.]ri 
E [x  wn]ri  +  E [x  w22ir2  +  E[x  w2r]r2 


E[x  y1Q] 
E[x  y2Q] 


Itx  wrlir1  +  e [x  wr2ir2  +  e [x  wrrirr 


E[xy  ] 
■'ro 


Or  in  compact  form: 

(E(xw)  } -  E(x  (21) 

If  the  set  H^(p) (p)  is  properly  chosen  in  accordance  with  x(t)  and 
T (p) ,  the  covariance  matrix  E{ (xw) }  has  an  inverse  and  the  solution  of  £  is 
unique  and  is  given  by: 

T  ■  r  ■  -  (E(xw)}  ^e{x  y  }  (22) 

—  — o  =-o 

The  elements  w^  in  Eq.  (20)  are  specifically  given  as  follows  in  terms  of 
Laplace  transforms: 


Wi  *  V  H(s)  1 

■  X  sSi  (s)  J 
o 


i  m  0  f  1  r  ■  1 1  f  £ 

i  ■  £  +  1 f  £  +  2, . . . ,r 


With  the  set  (s) ,  j  ■  1,2,...,  r  one  has: 


w^j  m  y^s  (s);  i  ■  /!/•••>£ 


x^s  Hj (s) j  i—i+l^  £  +  2,. . . ,r 


In  order  to  compute  the  expectations  in  Eq.  (20)  ,  the  following  property  of  the 


cross>correlation  function  E 


[x(t)wi(t+r)  J  ■  ^  (t)  is  made  use  of: 


R  (t) 
xw^  '  ' 


7TRxw  (r) 
dr  c 


7TV<T> 

dt  o 


A  convenient  operator  for  H. (s)  is  a  pure  time  delay 


This  results  in: 

R*w  <T>  ■  ~T  Rxy  <T  -V’  3  ■  1'J . r  (27) 

ij  dx  *o 

which  means  that  R  it)  is  R  (t)  shifted  in  the  negative  direction  of 

xw^  xw^ 

t  by  jxQ.  For  the  covariances  one  has: 


E(lwij’  ■  Rx»  <°>  "  ‘Ti  Rxy  (,,1T.JT  ’ 
J  ij  dx  Jo  J  o 


i  «  0,1, ... ,i 


“  R  T  . 

.  i  XX  T-jX  } 
dT  J  o 


i  m  1  t  1, . . .  ,r 


j  ■  0,1,2, .. . ,r-l 


T  >  0 


Provided  that  the  derivatives  at  t  -  jxQ  exist  for  all  j.  These  expressions 


are  abbreviated  as  follows: 


‘7rR«y  •R^>h>,.jT  • 

dx  •'o  o  Jo  o 


R(i)(x)  .  , 

XX  T«jTQ 


i  “  0,  1 , . . . , 1 


i  »  1  +  1, . . . ,r 


j  **  0,1,2,. ..,r-l 


x  >  0 


The  choice  of  H^(s)e 


-jx  s 


has  two  advantages: 


1.  It  has  the  power  to  generate  a  set  of  independent  equations  (2) 


over  a  wide  range  of  frequencies. 

2.  in  exploring  the  method  numerically  all  the  elements  in  the  matrix 

(E(xw)}  of  Eq.  (21)  re  easily  determined  from  the  single  expression 

of  the  cross-corre' ition  R  (x)  and  autocorrelation  R  (x). 

xy  xx 

Jo 

Dropping  the  indices  in  Eqs.  (29),  Eq.  (20)  takes  the  form: 


(1) 


.  (2) 


R'*'(0)r1  +  r'*'  (o)r2  +  R(r)(o)rr 


(l) 


,(2) 


<Vri  ♦  *"' ‘Vj  + . -  R'r)(Vrr 


,(D 


,  (2) 


[(r-l)To]ri+Rv"/ [(r-l)To]r2+<<#+R(r)  [(r-1)To]rr  -  -  R[ (r-1) tq]  J 


-  R(0) 


R(T  ) 

o 


>  (30) 


Since  jt  (j  ■  0,1,2,. .. ,r-l)  are  positive  time  shifts  of  the  origin, 
only  the  region  x  >  0  is  of  interest.  In  compact  form,  the  unbiased 


estimate  then  takes  the  form: 

r  «  r  -  -{R}_1R 

—  — O  — 


(31) 


The  definitions  of  the  matrix  {r}  and  the  vector  R  are  self  evident  from 


Eq.  (30). 

3.  IMPLEMENTATION  OF  THE  EEIC  METHOD 


In  the  actual  implementation,  the  set  of  linear  operators 
H1(P)»  H2 (p),...,Hr(p)  is  applied  to  the  input  x(t)  and  not  to  the  system 
output  y(t).  This  modification  considerably  simplifies  the  realization  of 
the  computer  program.  Denoting  the  set  of  corresponding  responses  by 
x  ,  x  ,...,x  ,  the  following  set  of  equations  results: 

X  a  IT 

E(x1w1)ri  +  E(x1w2)T2  +,...,  +  E(x1Wr)Tr  -  -  Efx^) 

E(x2v1)T1  +  e(x2w 2)T2  +,  ...,  +  E(x2wr)rr«  -  E(x2yQ)  ; 


E(XrWl)ri  +  E(xrW2)F2  +1  +  E(xrVrr  =  "  E(xryo) 


(32) 
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-<k-l)Tso 

Using  pure  time  delays,  the  responses  are  ■  xe  ,  k  *  l,2,...r. 

It  is  easily  verified  that  a  set  of  equations  equal  to  Eq.  (30)  is  obtained  since 

Eqs.  (20)  and  Eq.  (32)  are  completely  equivalent.  An  outline  of  a  hybrid 

analog  digital  computer  realization  is  shown  in  Fig.  2.  The  differentiations 

cure  conveniently  performed  in  the  analog  part  and  the  delays  and  multiplications, 

in  the  digital  part.  In  practice,  these  differentiations  are  not  pure  but  will 

take  the  form  s1/K(s),  where  K(s)  is  a  polynomial  in  s  of  order  q  >_  r. 

The  required  modifications  oi  the  cross  correlations  in  Eqs.  (28)  and  (29) 

are  straightforward  and  they  do  not  alter  the  results  of  Sec.  3.  It  is  important 

to  note,  however,  that  due  to  K(s)  ,  the  continuity  of  [R^(x)]  is 

xy  T*o 
-'o 

guaranteed  for  all  i.  With  the  time  delays  operating  on  the  input  x(t),  Eq. 
(15)  is  modified  as  follows:  e.g.,  for  the  j-th  equation  one  has: 


E[x(t-jx  )  e(t)  ]  -  [T(p)Q(p,o)  -  R(p,8)]R ( j  x  )  +  Q(p,a)E[x(t-jTo)n(t)  3  (33) 

v*  XX  O 

The  second  term  again  is  zero.  As  for  the  first  term,  it  sustains  the  validity 


of  condition  (16)  except  for  isolated  points  at  which  RXX^TC^  maY  zero» 
The  rU'+l)  products  x^  and  x.y^  are  stored,  averaged  and  processed  for 

/v 

the  solution  of  in  accordance  with  Eq.  (22) .  In  practice,  in  particular 

A 

if  "on-line"  identification  is  required,  the  solution  of  is  obtained  by 


a  recursive  average  process  (see  Appendix)  and  not  by  Eq.  (22) . 


The  parameters  of  G(s)  are  readily  determined  from  the  closed  loop  para- 

A 

meter  vector  of  T(s),  T  =  Col  (a,,  o_,...oB,  -  8  ,  -  B,*...-  8.  )  .  The 

— o  1  2  '  x  o  1'  h 

vanishing  of  the  excess  parameters  a  _,..., a„  and  8  ,  ,..,B,  is 

iti+i  jc  m+i  n 


guaranteed  by  Eq.  (16)  and  by  auxiliary  procedures  of  pole-zero  cancellation 
discussed  in  [7] . 


From  Eq.  (5)  one  has: 


G(s)  - 


1  -  L(s)T(s) 


Denoting  G(s)  ■  N' {s)/D'(s),  and  recalling  that  n  >  m,  then  for  e.g.  L(s)  ■ 
it  is  easily  verified  that  the  corresponding  parameter  vector  T_'  ■ 

11  III  I 

Col  (a,  ,a.  , . .  ,a  ,-0  ,  -0.,  ,....-0  )  of  N'  (s)/D'  (s)  is: 

12  no  »  m 

> 

a'  “l  ”  ^l 

1 “ -rrr 

o 


■  am  '  gm 
“m  "  1-0 

o 

'  am+l 

“m+1  "  1-0 


1-0 


«'  m  I 

m  "  1  -  0  * 

o 

The  appropriate  solution  of  £'  can  easily  be  determined  for  any  form  of  L(s) . 
If  x(t)  is  a  disturbance  operating  on  L(s),  the  EEIC  method  is  equally 
effective  and  the  slight  modifications  required  in  the  computations  are  straight 
forward. 

4.  NUMERICAL  EXAMPLES 
Example  1 

A  simple  numerical  example  based  on  time  delays  in  accordance  with  Eq.  (30) 


serves  to  illustrate  the  method.  The  system  S.  and  the  input  spectrum 


are  chosen  as  : 


T(s)  -  S 


6.25 


1  1  +  a^s 


1  +  1.25s 


O.S  +  s 


*xx(s)  "  (1  +  s)  (1  -  s) 


The  input-output  cross-spectrum  is: 


4>  (s)  -  4>  (s)T(s) 

xy  xx 

o 


(1+s)  (1-s) (0.8+s) 
The  corresponding  cross  correlation  function  is : 

t  >  0 


R  (t)  -  -  12.5  e“T  +  13.9e“°‘8T 
xy 

o 

-  1.39eT 


t  <  0 


The  input  autocorrelation  function  is: 

R  (  |t|)«  0.5e“lTl 
xx  1 

The  equation  error  is 

e  “  Y0  +  V1a1  -  *60 
The  EEIC  is  given  by 

2 

E  (ex)  -  E(xyQ)  +  Etxy^Jo^  -  E(x  )  80  -  0 
In  accordance  with  Eq.  (30)  we  have: 

R(1)  (0)a,-  R  (0)  8  -  -  R  (0) 

xy  1  xx  o  xy 

R(1)  (t  )a  -  R  (t  )8  -  -  R  (t  ) 

xy  o  1  xx  o  o  xy  o 

■'o  'o 


(35) 

(36) 


(37) 


(33) 


(39) 


(40) 


(41) 


(42) 


The  required  covariances  are  readily  determined  from  Eqs.  (38)  and  (39) 
Choosing  tq  «  0.5  sec,  Eqs.  (42)  become: 


1.4a,  -  0.58  «  -  1.39 

1  o 

0.15a  -  0.3058  «  -  1.72 
1  o 


(43) 


which  yield  the  exact  estimates:  8q  ■  6.25;  a^  -  1.25.  The  determinant  of 
Eqs.  (42)  is  det{R>  -  -  0.352.  This  quite  large  value  indicates  that  the 


matrix 


1.4  -0.5 


0.15  -  0.305 


is  far  from  being  singular  thus  demonstrating  the  effectivity  of  the  time- 
delay  operators. 

2 

Let  the  assumed  form  now  be  6q/ (1  +  a^s  +  a2s  ) .  The  equation  error  now 


•  ■  *  yl“l  *  Vj  -x8o 

and  the  set  of  equations  in  accordance  with  Bq.  (30)  is: 


R(2)  (0  a„  +  .R  1  (0  a.  -  R  (0)5  «  -  R  0) 

xy  2  xy  1  xx  o  xy 

Jo  Jo  o 

R(2)  (t  )a _  +  r(1)  (t  )a  -  R  (r  )6  -  -  R  (t  ) 

xy  o  2  xyQv  o  1  xx  o  o  xyQ  o 

R(2)  (2t  )a  +  R(1)  (2t  )a.  -  R  (2t  )  5  -  -  R  (2t  ) 
xy  o  2  xy  o  1  xx  o  o  xy  o 

Jo  Jo  o 

Choosing  again  =  0.5  sec.  Eqs.  (46)  become: 


-  3.6a„  +  1.4a.  -  0.56  =  -  1.39 

2  10 

-  1.52a-  +  0.15a.  -  0.3036  -  -  1.72 

2  1  O 

-  0.6a„  -  0.38a,  -  0.1846  =  -  1.62 


The  determinant  of  Eqs.  (47) is  det{R}  =  -  0.035  and  their  solution  is: 


a_  =  0;  a,  =  1.25;  6  =  6.25.  This  result  indicates  that  the  method  can 

2  1  O 

handle  "higher  order  models"  i.e.  models  in  which  the  powers  of  the  numerator 
and  denominator  are  higher  than  in  the  real  system,  S^.  The  excess  parameter 
estimate  a2  which  is  zero,  demonstrates  that  the  form  and  order  of  T(s)  = 
can  be  identified  along  with  the  parameters. 


Example  2 


The  second  example  Illustrates  the  identification  of  a  sero  and  a 


pole. 


T(s) 


1  ^  bo  ''  bl8  6.25  +  2.5s  ^  2.5  +  s 
1  "  1  +  a,s  "  1  +  1.25s  "  2  0.8  +  s 


^xx*8*  "  (1+s) (1-s) (2+s) (2-s) 


(48) 

(49) 


The  input-output  cross-spectrum  is: 


*  (s)  ■  *  (s)T(s) 

yo 


2(2.5  +  s) 


(1+s) (2+s) (1-s) (2-s) (0.8+s) 
The  corresponding  cross  correlation  function  is: 


(50) 


R  (t)  -  -  2.5e"T+  0.07e"2T+  2.82e"°‘8T; 
^o 

The  input  autocorrelation  function  is: 


Rxx(M)= 

The  equation  error  is: 


-2ITI 

12  ® 


T  >  0 


(51) 


(52) 


e  =  y  +  y.o  -  x  3  -  x. 8, 

o  11  o  o  11 


(53) 


The  EEIC  is  given  by: 

E(ex)  =  E(xy  )  +  E(xy.)a  -  E(x2)6  -  E(xx.)8.  -  0 

o  11  o  11 

In  accordance  with  Eq.  (30)  we  have: 


(53) 


R  1  (0)  a,  -  R  (0)8  -  R  1  (0)  8,  -  -  R  0 

xy  1  xx  o  xx  1  xy 

o  Jo 

R(1)  (t  )a,  -  R  (t  )8  -  R(1)  (t  )B,  -  -  R  (T  ) 

xy  o  1  xx  o  o  xx  o  1  xy  o 

R(1)  (2x  )a  -  R  (2t  )  8  -  R(1)  (2t  )  8,  =  -  R  (2t  ) 

xy  o  1  xx  o  o  xx  o  1  xy  o 

o  o 


(54) 


Choosing  tq  =  0.5  sec  as  before,  the  resulting  set  of  equations  is: 
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-  0.39 


0.1a,  -  0.0833$  -  0$,  - 

1  o  1 

-0.051a,  -  0.07$  +  0.04$,  -  -  0.4  (55) 

1  o  1 

-0.114a,  -  0.05$  +  0.039$,  -  -  0.354 

-4  J 

The  determinant  is  det  {r}'=-  10  and  the  solution  is:  $  *  6.25?  $,  ■  2.5; 

o  l 

ax  -  1.25. 

It  should  be  noted  that  in  this  example  x(s)  (Eq.  (49)),  has  been  chosen  sc 
that  R  (t)  at  t  ■  o  is  continuous.  This  guarantees  the  existence  of  R^^  (0) 

XX 

in  (54) .  In  practice  this  is  guaranteed  by  the  state  filter  K(s) . 

CONCLUSIONS 

It  has  been  shown  that  by  correlating  the  system  input  with  the  equation 
error  an  effective  and  relatively  general  algorithm  is  obtained  for  the  unbiased 
estimation  of  parameters  both  in  open  and  closed  loop.  By  properly  formulating 
the  equation  error,  it  has  also  been  demonstrated  that  the  order  and  form  of  the 
system  to  be  identified  must  not  be  precisely  known.  If  a  sufficiently  high 
order  model  can  be  afforded  in  the  computer  program,  the  excess  parameters  are 
estimated  as  zero  so  that  the  order  and  form  are  identified  along  with  the 
parameters.  The  method  is  amenable  to  hybrid  or  to  pure  digital  computing 
facilities.  In  the  development  of  the  actual  computer  software  a  recursive 
algorithm  will  be  employed  so  that  on-line  identification  can  be  achieved. 
Rapidity  of  convergence  of  the  parameter  estimate  and  its  variance  and  extensions 
to  multivariable  systems  are  subjects  for  further  work. 
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APPENDIX 


RECURSIVE  ON-LINE  IMPLEMENTATION. 


r 

-o 


-  {r  }”1r 


The  solution  of  the  parameter  vector  estimate  as  given  by  Eq.  (31)  is: 

(Al) 

where  the  elements  of  {r}  are  the  cross  correlations 

{R}  -  {R. .}  -  {R  _  (0)}«  {r  (t,  )}  (A2) 

ij  XWj  1 

i  —  0,1, ...  ,r 
j  »  1,2,... ,x 


and  the  elements  of  R  are: 


R  -  (RJ  -  <R  »  (0)) 

xjyo 


<Rxyo(Tj>  J  *  °'1 . r 


(A3) 


For  on-line  implementation  a  hybrid  computer  may  be  used,  where  the  time 


delay  is  performed  in  the  digital  part  and  the  cross  correlations  are  computed  by: 

k 

(A4) 


(t)  ■  r-  Z  x(iT  -  x)y(iT) 
xy  *  i-1 


T  is  the  sampling  interval  end  k  the  number  of  samples.  Eq.  (A4)  may  be 

be  written  in  a  recursive  form  which  enables  real  time  processing. 

k+1 


Jc+1 ,  .  1 

Rxy  (T|  "  kTT  .  , 
1-1 


Z  x(iT  -  i)y(iT) 


Z  x  (iT-x)y  (iT)  +  x[  (k+l)T-T]y[  (k+l)T] 
i=1  k 

v  R*  (T)-x[(k+l)T-T]y[(k+l)T) 

RxyW  -  ^ - — - 


(A5) 


Eq.  (A5)  may  be  rewritten  as  follows: 


_k+l .  .  _k  ,  .  ,  . „k+l ,  , 

R  (t)  «  R  (t)  +  AR  (t) 

xy  xy  xy 


(A6) 


where : 
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R  (T)  -  X[(k+I)t-T]y[(k+1)T] 
AR"'~(t)  -  -  Sl- 

xy 


k+1 


(A7) 


{Rk+1}  -  {Rk}  +  {ARk+1} 


k  +  1 

Thus  every  sample  (consisting  of  xft^) ,  y^t^)  ,  w^t^)  i  -  1,2,.  ..,r) 
updates  the  elements  of  {R}  and  R  recursively 

(A8) 

R'  -  Rk  +  AjRk+1  (A9) 

The  elements  of  {Ar}  and  Ar  ,(Eqs.  A2-A3)  are  computed  using  Eqs.  (A6-A7) . 
Substituting  Eqs.  (A8-A9)  into  (Al)  we  obtain: 

(A10) 


Jc+1 


k+1 


£  —  -  -  ({RK>  +  {ARk+1})_1(Rk  +  ARk+1) 

Using  the  well  known  matrix  inversion  lemma 

({Rk}  +  {ARk+1})-1  .  {Rk}-1-  {Rk}-1{ARk+1}tI  +  {Rk}‘1{ARk+1}]"1{Rk}‘1 
-  {R1*}'1  +  {3Rk+1} 

where 

{<SRk+1}  -  -  {Rkr1(ARk+1}[l  +  {Rk}"1{ARk+1}]‘1{Rk}"1 
Substituting  in  Eq.  (A10) 


(All) 


(A12) 


:k+i 


r**r*  -  [{Rk}-1  +  {6Rk+1}]  (R  +  ARk+1)  - 

-  (Rk}~^  Rk-[{Rk}"1ARk+1  +  {6Rk+1}(Rk  +  ARk+1) ] 


-k+1. 


(A13) 


Denoting 


A£k+1  .  -  ({Rk}  1ARk+1  +  (6Rk+1}(Rk  +  ARk+1)) 


(A14) 


and  since 


fk  .  -  {Rk}_1Rk 


(A15) 


Eq.  (A13)  becomes 


;k+i 


rk  +  Ark+1 


)  A16) 


)c  “  1 

To  provide  the  initial  value  of  (r  }  the  initial  measurements,  say  the  first 


ten  measurements,  should  be  processed  using  Eqs.  (A4,  A15)  obtaining  {R10},R10' 


,10 


£  With  these,  the  recursive  process  (Eqs.  A8,  11,  14,  16)  can  be  started  (with 
k-10) . 
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ABSTRACT 

Fine-motor  unsteadiness  limits  the  accuracy  of  perceptual-motor  control  as  described 
e.g.  by  Magdaleno  et  al .  at  the  1973  Annual  Manual.  At  least  a  portion  of  these  minute 
limb  movements  are  referred  to  as  normal  tremor.  New  measurements  on  forefinger  tremor 
and  a  resulting  simplified  tremor  model  are  presented  and  discussed. 

In  our  experiments  forefinger  tremor  showed  a  sharp  peak  in  the  frequency  spectrum  of  the 
acceleration  at  20  -  25  Hz  which  is  clearly  separated  from  the  peaks  of  hand  tremor 
(10  Hz)  and  forearm  tremor  (1-3  Hz).  At  the  same  time  the  "EMG  pulsations"  at  the 
corresponding  forefinger  extensor  muscle  showed  a  broad  spectrum  with  a  flat  maximum 
at  about  15  Hz.  When  we  added  ar.  extra  mass  (up  to  90  g)  the  peak  of  the  acceleration 
spectrum  was  shifted  towards  lower  frequencies  while  the  EMG  spectrum  remained  un¬ 
changed.  Our  results  indicate  that  this  type  of  tremor  can  be  described  by  o  linear  mechani¬ 
cal  model  without  a  neuromuscular  reflex  loop  which  moy  well  play  a  role  in  other  types 
of  tremor  as  e.g.  force  tremor. 

A.  INTRODUCTION 

It  has  long  been  known  that  posture,  as  well  as  voluntary  movements  even  in  healthy 
subjects,  are  associated  with  physiological  tremor.  These  small  rhythmical  involuntary 
fluctuations  in  position  of  various  body  parts  impair  the  accuracy  of  fine  motor  performance. 
For  example,  in  control  tasks  using  a  smoll  finger  stick  or  in  the  use  of  hand  field  glasses 
[1  ],  the  resolution  is  limited  by  tremor  oscillations.  Other  examples  are  mentioned  by 
Allen,  Magdaleno  and  Jex  [2  ]and  other  authors  [3  ]  .  However,  every  possible  means 
which  can  be  employed  to  reduce  the  influence  of  tremor  movements  depend  on  knowledge 
of  its  frequency  distribution.  Therefore,  it  is  important  to  analyse  the  tremor  frequency 
spectrum,  and  also  to  get  some  insight  into  the  origin  of  the  oscillations.  These  tasks  can 
be  assisted  by  modeling  different  possible  system  configurations. 

1 .  Servo-loop  hypothesis  :  In  previous  studies,  the  postural  tremor  is  reported  to  show 
Its  predominant  frequency  at  about  10  cycles  per  second.  Lippold  [4,  5  ]  concluded  from 
his  experiments  on  finger  tremor  that  physiological  tremor  in  the  8  -1 2  Hz  band  is  due  to 
oscillation  in  the  reflex  servo-loop.  Also  other  authors  have  been  in  favour  of  the  reflex 
loop  hypothesis  [6,  7  ]  .  However,  it  seems  to  be  clear  now  that  it  is  impossible  to  define 
a  uniform  or  unique  tremor  frequency.  On  the  basis  of  peaks  in  the  tremor  frequency 
spectrum  it  is  possible  to  make  distinctions  between  finger  tremor  (20  -  25  Hz),  hand 
tremor  (8-10  Hz),  and  forearm  tremor  (1-3  Hz)  [  8,  9  ]  .  The  disagreement  in  the 
above  results  moy  be  explained  by  differences  in  the  experimental  situation.  For  example. 
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Lippold's  measurements  at  the  finger  tip  comprised  mainly  hand  tremor  movements 
masking  the  finger  tremor  with  its  much  lower  amplitude  values.  Two  reasons  are 
responsible  for  this  strong  masking  of  finger  tremor  :  (1)  the  detection  of  finger  displace¬ 
ment  instead  of  the  acceleration/  results  in  smaller  amplitudes  of  the  frequency 
peak  relative  to  higher  amplitudes  in  the  lower  frequency  band  of  hand  tremor ;  and  (2) 
the  positioning  of  the  hand  on  the  table  in  a  manner  which  allows,  at  least,  a  portion 
of  hand  tremor  movements  to  be  superimposed  on  finger  movements. 

2.  Mechanical  filter  hypothesis  :  In  contrast  to  the  servo  mechanism  hypothesis,  tremor 
could  be  described  as  a  feature  of  an  underdamped,  second-order,  linear  system 
according  to  the  mechanical  properties  (mass,  spring,  damping)  of  a  limb-muscle  system 
[8,  9,  10,  11].  This  system  is  activated  through  forces  developed  by  the  muscles 
involved.  These  muscle  forces  may  be  estimated  by  recording  EMG  activities.  This  is 
possible  because  at  least  for  small  changes  in  the  force  an  approximately  linear  relation¬ 
ship  between  EMG  activity  and  the  exerted  muscle  force  con  be  assumed  [12,  13  ]  . 

The  mechanical  filter  hypothesis  predicts  the  tremor  peak  frequency  to  decrease  with 
added  weights  without  a  shift  in  the  lower  frequencies  of  the  EMG  spectrum. 

Based  on  these  considerations  we  studied  finger  tremor  in  order  to  discriminate  between 
the  servo- loop  and  mechanical  filter. 

B.  EXPERIMENTS  ON  FINGER  TREMOR 

1 .  Methods :  The  hand  was  rested  in  a  relaxed  position  on  a  special  support  [  10,  11] 
with  the  index  finger  extended  as  shown  by  figure  1 .  This  support  was  designed  to 
eliminate  hand  movement. 

The  forearm  was  held  in  a  pronated  position  and  supported  at  the  elbow  region.  An 
accelerometer  (weight  4g)  was  attached  to  the  end  phalanx  of  the  index  finger  picking  up 
the  flexion-extension  movement  selectively.  The  acceleration  frequency  spectrum  was 
obtained  by  means  of  a  filter  bank  as  described  by  Alewijnse  and  Koster  [14  ]. 

The  EMG  signals  were  picked  up  with  a  pair  of  surface  electrodes  (8  mm  diameter, 

40  mm  interdistance)  from  the  distal  part  of  the  M.  extensor  indicis,  and  then  amplified 
(flat  between  15-1000  Hz  [10  ]).  Signals  were  processed  further  by  double-wave 
rectification  and  low-pass  filtering  (24  dB/oct. ,  about  30  Hz  cut  off  frequency) ;  the 
result  being  an  envelope  of  the  EMG  signal .  The  frequency  spectrum  of  the  EMG  envelope 
was  analyzed  by  using  the  same  filter  bank  as  for  the  acceleration  processing. 

Additional  weights  were  attached  around  the  first  phalanx  in  the  form  of  small  pieces 
of  lead. 
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acceleration  pick  up 


Figure  1  :  Arrangement  for  finger  tremor  measurements 

2.  Results  ;  The  acceleration  amplitude  of  the  forefinger's  oscillations  is  shown 
^FigureT!2a5"as  a  function  of  frequency  for  two  different  example  masses.  When  the  fore¬ 
finger  was  loaded  with  16  g,  the  frequency  spectrum  showed  a  peak  at  20  Hz.  This  peak 
was  shifted  down  to  9  Hz  when  the  extra  mass  was  increased  to  87  g. 

The  EMG  envelope  spectrum  is  shown  by  figure  2b.  Here,  too,  a  peak  frequency  is 
observed,  but  the  peak  is  not  very  sharp  ;  the  spectrum  is  much  broader  than  that  of  the 
acceleration.  Different  weights  up  to  about  100  g  did  not  cause  any  shift  of  the  flat 
maximum  ;  there  is  no  change  in  the  form  of  the  noiselike  spectrum  which  could  be  related 
to  changes  in  the  acceleration  spectrum  of  figure  2a. 

Similar  results  were  obtained  with  various  masses  [10  ]and  different  subjects  as  well  as 
when  a  different  method  for  spectrum  analysis  was  applied  [15  ]. 

3.  Discussion  and  filter  modeling  :  The  acceleration  spectra  showed  sharp  peaks  and  are 
in  good  agreement  with  results  reported  in  the  literature  [8,  10,  15  ].  The  EMG  spectra 
were  much  broader  and  showed  no  changes  when  a  mass  was  added. 

Thinking  in  terms  of  a  mechanical  filter  the  following  concept  has  to  be  tested.  The 
frequency  spectrum  of  the  EMG  envelope  may  be  taken  as  a  representation  of  the  muscle 
fcrces  as  already  mentioned.  The  mechanical  resonant  system  is  driven  by  varying  muscle 
forces  which  have  a  broad  frequency  spectrum,  and  it  filters  out  a  narrow  band  of  the 


EMfc  relative  output  [•/•]  acceleration  relative  output  [•/ 


whole  input  driving  spectrum.  The  spectrum  of  the  acceleration  can,  therefore,  be 
expected  to  primarily  indicate  the  porperties  of  the  mechanical  filter.  A  comparison 
of  the  spectra  of  figure  2a  and  2b  reveals  no  equivocal  relationship  between  the  driving 
force  and  the  filter  response. 

This  concept  is  also  in  agreement  with  results  reported  and  discussed  by  Hamoen  [16  ] 
concerning  hand  tremor  oscillations.  The  results  of  Fox  and  Randall  [9  ]  obtained  by 
detecting  the  forearm  tremor  and  the  envelope  of  the  biceps  EMG  are  essentially  the  same, 
thus  supporting  the  mechanical  filter  concept. 

Using  a  second-order  linear  filter  equation  to  describe  the  acceleration  spectrum  of  fore¬ 
finger  movements,  it  is  possible  to  estimate  the  shift  of  the  peak  frequency  caused  by 
increasing  the  mass.  Taking  the  effective  mass  of  the  finger  to  be  M  ,  the  peak  frequency 
is 


f 

o 


0) 


while  c  is  the  stiffness  of  the  system.  Assuming  the  stiffness  c  to  be  independent  of  the 
added  mass,  we  get 


f  =  ~  — 1 -  (2) 

res  . - - 

yV™ 

This  means  that  with  additional  masses  attached  to  the  finger,  the  frequency  will  decrease 
with  the  square  root  of  the  total  mass. 

Assuming  that  the  moved  mass  of  our  subject's  finger  system  is  about  M  =  10  g,  we  can 
start  with  the  peak  frequency  of  25  Hz  where  no  mass  is  added  except  fte  transducer ; 
and  calculate  the  shift  corresponding  to  the  mass  m. .  By  applying  (1)  recurrently,  we 
can  use  the  ratio 


Vm2 

|M  +  m, 
o 


for  calculation  of  the  resonance  frequencies. 


(3) 


The  table  below  shows  that  the  results  of  this  approximation  are  in  good  agreement  with 
the  measurements  [10  ]: 
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Table 


mass 

f  peak  Hz 

f  peak  Hz 

9 

measured 

predicted 

4 

25 

25 

16 

19 

18.5 

45 

12.6 

12.5 

87 

9 

9.5 

Figure  3  shows  the  relation  between  mass  and  resonance  frequency  represented  by  a  line 
starting  from  zero  as  predicted  by  the  model .  Various  data  points  of  resonance  frequencies 
of  finger  oscillations  were  entered.  These  data  points  were  derived  from  our  experiments 
[I0]and  those  of  other  investigators.  Measurements  of  physiological  tremor  [8  ,  10]  and 
measurements  of  die-away  oscillations  following  a  sharp  tap  to  the  finger  [12  ]  were 
included. 

Each  set  of  values  entered  fell  on  a  line  parallel  to  the  theoretical  line  of  the  model. 
Effective  finger  mass  values  were  of  course  not  given  in  the  literature,  since  they  can  not 
easily  be  measured  directly.  However,  it  is  reasonable  to  assume  these  masses  differ  with 
different  subjects.  Effective  finger  mass  assumptions  can  be  made  in  such  a  way  that  the 
values  are  situated  very  close  to  the  theoretical  line.  In  fact,  this  procedure  is  an  indirect 
method  for  estimating  the  effective  finger  mass. 

The  agreement  between  data  and  the  model  tend  to  support  the  mechanical  filter 
hypothesis.  In  addition,  the  assumption  of  the  system's  stiffness  to  be  a  constant  is 
supported. 

Our  experiments  involved  masses  up  to  100  g.  As  recently  reported  Koster  and  van  Schuur 
[15  ]  extended  their  measurements  to  extra  masses  up  to  184  g.  The  shift  of  the  acceleration 
peak  frequency  in  their  extended  range  of  masses  can  also  be  described  very  well  by  the 
filter  model.  But  in  that  range  the  spectrum  of  the  EMG  envelope  gradually  exhibited  a 
peak  at  the  tremor  frequency.  Similarly,  Lippold  [4,  5  ]  reported  EMG  pulsations 
synchronously  with  the  die-away  oscillations  follwing  a  tap  to  the  finger.  How  could 
these  phenomena  be  explained  in  accordance  with  the  filter  model  ? 

4.  Muscle  spindle  feedback  :  During  normal  tremor  oscillations,  the  maximum  amplitude 
of  the  finger  tip  is  about  0.2  mm  [4  ].  The  muscle  spindles  which  are  acting  in  the  reflex 
loop  as  the  sensors  seem  to  have  a  threshold  for  small  amplitudes  [17  ]  ,  i.e.  changes 
in  muscle  lenght  must  exceed  a  minimum  value  to  cause  an  excitation  of  the  muscle 
spindles.  It  can  be  assumend  that  the  tendon  organs  have  higher  thresholds  compared  to 
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those  of  the  sensitive  muscle  spindle  endings  [17  ]  .  Therefore,  only  the  muscle  spindle 
endings  will  be  taken  into  consideration  here.  On  the  basis  of  measured  data,  a  test  can 
be  made  of  the  proposition  that  the  length  of  the  muscle  spindles  (during  normal  tremor 
amplitudes)  can  be  changedsubthreshold,  while  during  the  marked  changes  in  length 
following  a  tap  on  the  finger,  this  threshold  could  be  exceeded. 


effective  total  mass  [g] 

Figure  3  :  Relationship  between  peak  frequency  f  and  moved  total  mass.  The  line  is 

given  by  the  2nd  order  filter  model, daPa  points  are  derived  from  measurements 
[6,8, 10].  Assumptions  for  finger  masses  M  :  Halliday  &  Redfearn  :  13  g; 
Stiles  &  Randall  :  12  g  ;  Rau  &  Vredenbregt  f  10  g. 

In  the  following  discussion,  the  finger  system  is  approximated  by  the  model  given 
schematically  in  figure  4.  The  length  of  a  rigid  forefinger  is  assumend  to  be  10  cm,  and 
the  tendon  connected  to  the  finger  1  cm  distant  from  the  axis  of  rotation  (metacarpal 
joint).  Further,  it  can  be  assumed  that  tendon  stiffness  is  many  times  that  of  muscle  tissue. 
Therefore,  a  displacement  of  the  finger  tip  will  cause  a  change  only  in  muscle  length. 

On  the  basis  of  these  assumptions,  during  normal  tremor  a  finger  tip  displacement  of 
0.2  mm  causes  a  change  in  muscle  length  of  about  0.02  mm.  For  a  totol  muscle  length  of 
about  200  mm  the  relative  change  in  length  is  0.02/200  =  1/10  000.  The  amplitudes  of 
the  finger  tip  displacement  observed  as  a  response  to  a  tap  was  about  1 .5  mm  [4  1, 
causing  a  change  in  muscle  length  of  0.15  mm.  Thus  the  relative  change  is  0.15/200  = 
1/1  330.  The  results  are  illustrated  in  figure  5. 


The  most  sensitive  parts  of  the  muscle  spindle  receptor  ere  the  primary  endings.  For 
example,  changes  in  the  length  of  the  muscle  spindle  of  0.05  mm  or  somewhat  less,  lead 


for  small  displacements : 

sin  a  s  a  — -1Q0  *\ 


0.02 
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tendons 


Figure  4  :  Simplified  model  of  a  finger  (figures  are  scaled  in  mm) 


to  changes  in  the  spindle  firing  rate  [17  ]  .  In  the  situation  as  given  by  the  proposed 
model  it  is  difficult  to  estimate  the  factual  length  change  of  the  spindles  when  the  sur¬ 
rounding  muscle  tissue  is  stretched  I  In  addition,  the  finger  muscle  is  very  long  with 
respect  to  its  extension.  It  can  be  expected  that  a  dynamic  extension  of  the  whole 
muscle  at  a  tremor-like  frequency  (e.g.  25  Hz)  will  result  in  only  a  partial  stretch  of 
the  primary  endings  of  the  spindle. 

Experiments  with  the  soleus  muscle  of  the  cat  [17  ]have  shown  :  when  a  sinussoidal  length 
variation  was  applied  to  the  tendon  at  a  frequency  of  100  Hz  the  lowest  amplitude 
threshold  of  the  most  sensitive  primary  ending  showed  to  be  about  0.005  mm.  This 
corresponds  to  a  relative  change  in  muscle  length  of  1/10  000  (fig.  5).  In  the  experimental 
situation  the  sensitivity  of  the  primary  endings  was  already  enhanced  by  a  mechanical 
prestretch  of  the  muscle. 

It  can  be  further  assumed  that  the  amplitude  threshold  of  the  spindle  is  also  about  the 
same  magnitude  in  the  range  of  tremor  oscillations.  In  the  literature  no  comparable 
electrophysiological  measurements  on  humon  subjects  are  available  which  would  permit 
a  determination  of  the  threshold  of  muscle  spindles  relative  to  total  muscle  length  changes. 
Therefore,  the  results  of  the  cat  experiments  are  used  tc  give  some  indication  of  the  order 
of  magnitude  in  sensitivities  in  judging  the  situation  of  finger  tremor. 

Comparing  the  cat  soleus  threshold  reported  by  Mathews  [17  ]  with  the  finger  movement 
amplitudes  estimated  in  the  model  (figure  4),  one  can  presume  that  the  amplitude  of 
normal  tremor  may  be  too  small  to  excite  the  muscle  spindles  in  the  human  finger  muscle. 

In  contrast,  the  amplitudes  of  die-away  oscillations  in  response  to  a  tap  on  the  finger 
could  exceed  the  threshold  of  the  muscle  spindles.  Also,  during  oscillations  with  additional 
masses  above  100  g  the  finger  movement  amplitudes  were  increased  markedly  [  15  ]  . 
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Figure  5  :  Estimated  changes  of  relative  muscle  lengths 


Consequently,  it  should  not  be  expected  that  in  normal  finger  tremor  the  frequency  is 
determined  by  the  reflex  loop,  since  it  can  be  considered  to  be  an  open-loop  circuit 
This  is  because  feedback  is  missing  due  to  the  receptor  being  excited  only  subthreshold. 
The  force  driving  the  finger  system  is  supplied  by  the  resting  activity  of  the  muscle.  This 
is  in  agreement  with  the  observation  that  EMG  activity  was  constant  and  showed  no 
pulsations  with  the  same  rhythm  as  occurred  in  the  movements.  In  the  case  of  a  tap  to  the 
finger  the  reflex  loop  would  be  closed,  since  the  greater  movement  amplitudes  can  cause 
a  spindle  excitation.  As  expected,  EMG  pulsations  with  the  same  rhythm  of  the  finger 
oscillations  are  observable,  as  shown  by  Lippold's  investigations  [4,  5  ]  .  But  the  EMG 
pulsations  can  not  be  considered  as  the  cause  of  these  finger  movements,  they  are  only 
a  consequence. 
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C.  TREMOR  MODELS 


In  this  section  an  attempt  is  made  to  describe  models  which  incorporate  all  the  above 
mentioned  results  and  which  enable  on«  to  make  predictions  with  respect  to  other  types 
of  tremor. 

Three  separate  models  are  illustrated  scher.  jtically  (figure  6).  With  small  modifications 
these  modells  can  be  combined  into  one.  They  were  simulated  on  an  analog  computer. 


Figure  6  :  Models  describing  3  different  types  of  tremor  ;  (a)  2nd  order  filter,  (b)  Reflex- 
loop  model,  (c)  Central  rhythm  model 

1.  Linear  mechanical  filter  ;  This  model  is  shown  in  figure6a.  The  shift  of  the  peak 
frequency  (f  )  as  illustrated  in  figure  2 a  was  previously  discussed  in  section  B3.  Figure  7 
shows  the  spectra  of  the  acceleration,  the  velocity  and  the  displacement  for  different 
values  of  the  mass.  These  results  are  similar  to  those  described  in  figure  2a.  Notice  that 
the  variations  in  peak  amplitudes  are  not  to  be  seen  in  figure  2a  because  of  the 
normalization  to  100  %.  However,  the  tremor  amplitudes  are  worthwhile  studying  in  the 
future  because  they  can  provide  indications  about  increases  in  input  force  as  well  as 
changes  in  the  mechanical  properties  of  the  oscillating  system. 
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Figure  7  :  Resonance  curves  of  a  linear  2nd  order  filter  (spring,  mass,  damping  )  with  the 
mass  as  a  parameter  (a)  displacement  spectrum  (b)  velocity  spectrum 
(c)  acceleration  spectrum 


2.  Reflex-loop  model  ;  The  length  and  the  tension'of  a  skeletal  muscle  is  at  least  partly 
controlled  by  the  reflex  loop  of  the  stretch  reflex.  As  anticipated  with  greater  oscillation 
amplitudes/  the  muscle  spindles  are  excited  superthreshold,  when  the  loop  becomes  closed 
as  indicated  in  figure  6b.  From  control  systems  theory  it  is  well  known  that  such  a  closed 
loop  can  have  the  tendency  to  oscillate  or  even  to  become  unstable  if  a  given  delay  time 
exists  and  the  loop  gain  exceeds  a  limiting  value.  The  finite  signal  velocity  of  nerve 
transmission  and  the  synapse  time  constants  cause  a  real  delay  time  of  the  reflex  loop  of 
about  30  msec.  Ibis  estimate  is  derived  from  electrophysiological  data  [  18  ]  .  At  a 
tremor  frequency  of  10  Hz  [4/  5  ]the  delay  time  would  have  to  be  about  100  msec  if  the 
reflex  loop  were  responsible  for  the  oscillations.  Subsequently,  a  simple  simulation  of  the 
finger  system  including  the  reflex  loop  was  tested  with  the  two  delay  times  :  30  msec 

and  1 00  msec . 

The  feedback  signal  detected  by  the  muscle  spindle  contains  not  only  information  of  the 
displacement  but  also  of  the  velocity  (and  possibly  also  of  the  acceleration).  Thus,  a 
whole  set  of  different  cases  of  positive  and  negative  feedback  configurations  had  to  be 
investigated.  Combinations  of  displacement,  velocity  or  acceleration  as  feedback  signals 
were  not  studied.  The  results  of  these  experiments  can  be  summarized  as  follows  :  No 
stable  oscillations  occurred  without  the  peak  frequency  rarying  with  the  additional  mass. 
These  results  contradict  the  hypothesis  that  the  reflex  loop  may  be  the  origin  of  normal 
tremor  oscillations  at  a  uniform  frequency  of  10  Hz. 

An  additional  property  of  the  reflex-loop  model  was  observed  when  the  oscillation 
frequency  was  shifted  close  to  that  given  by  the  delay  time  ;  this  shift  can  be  accomplished 
either  by  changing  the  mass  or  the  proportional  feedback  gain.  When  this  was  done,  the 
system  became  unstable  and  the  amplitudes  would  have  increased  indefinitely  if  the 
amplifiers  of  the  analog  computer  had  no  limit.  Because  of  this  non-liniarity  a  further 
shift  in  the  frequency  through  an  increase  in  mass  was  not  to  be  detected,  while  an 
increase  in  the  input  force  amplitude  still  caused  an  increase  of  the  movement  amplitude. 
The  output  signal  was  still  nearly  sinussoidal.-  Are  there  similar  tremor  phenomena  to  be 
seen  in  human  limbs  ? 

3.  Experiments  on  force  tremor  ;  To  answer  that  question  I  made  experiments  on  isometric 
contraction  (flexion  and  extension)  of  the  hand.  The  isometric  contraction,  or  rather, 
static  contraction  in  respect  to  movement  is  similar  to  a  contraction  for  moving  an 
indefinitely  large  mass.  The  subject  was  asked  to  sustain  a  moderately  large  force.  Force 
variations  after  eliminating  the  IX  level  and  the  EMG  activities  at  the  flexor  and 
extensor  muscle  groups  were  recorded  simultaneously  as  shown  in  figure  8. 

One  can  see  force  oscillations  which  are  of  the  same  frequency  as  the  fluctuations  in  the 
EMG  envelope  at  the  agonist  muscles.  At  the  antagonist  muscles  only  a  very  low 
activity  is  to  be  detected,  it  is  almost  slack.  During  flexion  the  result  is  basically  the 
same  as  during  extension.  The  oscillation  frequency  in  both  situations  was  about  12  Hz 
and  was  seen  to  be  very  stable  and  independent  from  the  sustained  contraction  force  in 
a  wide  range.  The  oscillation  amplitudes  increased  with  increasing  forces. 
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Figure  8  :  Record  of  isometric  flexion  and  extension  at  the  wrist 


This  type  of  tremor  is  different  to  the  type  of  normal  or  postural  tremor  and  may  be 
called  "force  tremor".  Here  a  reflex  loop  plays  a  role  because  the  EMG  and  exerted 
forces  showed  oscillations  of  the  same  frequency.  It  can  be  assumed  that  the  stretch 
reflex  is  responsible  for  this  phenomena.  The  results  cannot  be  due  to  a  reflex  system 
combining  the  agonist  and  antagonist  muscle  groups  since  the  antagonist  showed  nearly 
resting  activities  indicated  by  the  small  EMG  signal  as  shown  in  figure  8.  Similar  results 
can  be  observed  when  the  forearm  is  loaded  by  a  big  mass  and  the  EMG  activity  of  the 
biceps  muscle  is  compared  to  accelerations  in  forearm  oscillation  movements  ;  the 
frequency  of  this  tremor  also  showed  to  be  about  1 1  Hz.  Additional  similar  results  are 
reported  by  Magdaleno  et  al.  [  2  ]  for  finger  oscillations  :  the  frequency  of  the  forefing- 
was  about  12  Hz.  Different  exerted  forces  caused  changes  in  amplitude  while  no  marked 
changes  in  frequency  are  to  be  seen. 

4.  Central  rhythm  model  :  A  further  type  of  tremor  can  be  due  to  rhythmical  excitations 
with  its  origin  in  the  central  nervous  system  as  observed  e.g.  with  Parkinson  tremors 
[19  ]  .  Our  simulation  tests  of  the  model  illustrated  in  figure  6c  showed  that  the 
oscillation  frequency  of  the  finger  model  is  determined  by  the  rhythmical  force 
changes  at  the  input  independent  of  the  mass.  This  is  i  n  agreement  with  measurements 
on  hand  tremor  of  Parkinson  patients  [20  1 ;  which  show  that  the  sharp  peak  in  the 


acceleration  spectrum  coincided  with  the  peak  in  the  EMG  spectrum  and  an  extra  mass 
caused  only  a  very  small  shift  of  these  peaks. 

D.  CONSEQUENCES  AND  APPLICATIONS 

1 .  Consequences :  The  measurements  and  the  model  studies  give  strong  evidence  for 
different  types  ol  tremors  depending  on  their  origins.  Distinctions  can  be  made  between 
these  types,  (a)  by  changing  the  mechanical  properties  of  the  moving  system,  and  (b)  by 
using  the  surface  EMG  as  an  indication  of  the  muscle  activities  and  thus  indirectly  of  the 
muscle  forces.  A  prerequesite  for  a  reliable  tremor  measurement  is  a  well  defined 
positioning  of  the  moving  limb.  As  a  future  goal,  measuring  techniques  for  the  quantitative 
evaluation  of  amplitudes  has  to  be  worked  out.  A  better  quantification  would  also  permit 
detection  of  the  bandwidth  of  resonance  curves.  This  gives  an  indication  of  the  mechanical 
parameters  of  the  moving  system  such  as  damping.  For  each  experimental  situation  it  should 
be  determined  whether  the  displacement,  the  velocity  or  the  acceleration,  or  even  all 

of  them  simultaneously,  should  be  recorded  [21  ]  . 

Still  an  unsolved  problem  remains  with  the  assumption  that  stiffness  in  the  mechanical 
filter  model  may  be  constant.  It  is  known  [22,  23,  24  ]  that  an  increase  in  muscle  force 
also  increases  the  stiffness  of  the  muscle.  When  the  finger  was  loaded  with  an  extra  mass 
the  EMG  activity  increased.  This  means  an  increase  in  force  and,  therefore,  an  increase 
in  stiffness  had  to  be  expected.  To  avoid  this  problem,  Stiles  and  Randall  [8  ]  instructed 
their  subjects  to  keep  the  EMG  activity  constant  by  providing  them  with  visual  feedback 
while  adding  different  loads.  The  aim  was  to  keep  the  stiffness  of  the  muscle  independent 
of  the  load.  In  fact,  the  same  relation  between  frequency  and  mass  as  defined  by  equation 
(2)  was  found. 

2.  Applications  :  In  each  design  of  an  arm,  hand,  or  finger  control  the  tremor  phenomena 
have  to  ke  taken  into  consideration,  especially  when  fine  control  movements  have  to  be 
performed.  For  example,  a  well  defined  positioning  support  of  the  arm  and  possibly  of  the 
hand  can  prevent  the  arm  and  hand  tremor  movements  from  disturbing  or  limiting  fine 
control  with  a  finger  stick.  Similarly,  an  isometric  control  may  be  used  only  with  small 
sustained  forces.  Otherwise  no  fine  control  would  be  possible  because  of  the  occurrence 
of  force  tremor  oscillations. 

Before  selecting  deflection  resistance  for  a  control  (mass,  spring,  damping  as  a  function 
of  the  displacement)  one  has  to  test  the  behaviour  of  the  whole  system  including  the  moved 
limb.  For  example,  a  big  mass  of  the  control  could  shift  the  resonance  peak  of  the  dis¬ 
placement  spectrum  too  much  towards  lower  frequencies  ;  while  an  appropriate  spring 
stiffness  could  cause  a  desired  shift  to  higher  frequencies  as  can  be  seen  from  equation  (1). 

Evaluation  of  tremor  amplitudes  can  be  utilized  in  two  other  fields  of  ergonomics.  (1) 

As  reported  in  the  literature  [25  ]  changes  in  the  amplitudes  of  physiological  tremor  are 
correlated  with  mental  laad  gnd  drug  influences.  Therefore,  an  index  of  mental  work  load 
could  be  obtained.  (2)  Tremor  is  reported  to  be  a  very  specific  feature  of  different 
subjects  [25  ]  .  On  the  basis  of  tremor  amplitudes  it  seems  possible  to  select  persons  who 
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DETERMINATION  OF  IN-FLIGHT  PILOT  PARAMETERS  USING 
A  NEWTON-RAPHSON  MINIMIZATION  TECHNIQUE 
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Abatract  —  Thla  paper  descri'  es  the  application 
of  a  Modified  Newton-Raphson  parameter  Identification 
program  to  a  poac-almulatlon  enalyala  of  a  larga 
delta-wing  aircraft  almllar  to  a  Concorde  auper- 
aonlc  tranaport.  Pilot  paraoatera  are  determined 
by  minimizing  tbe  weighted  mean  aquare  difference 
between  tha  computed  model  raaponaea  and  the  meaaur- 
ed  raaponaea  of  the  tote.,  pilot-vehicle  ayatem. 

Pilot  remnant  la  calcula  ed  ualng  a  power  apectral 
danalty  approach.  Theae  reaulta  ere  compared  to 
prealmulatlon  enalyala  reaulta  obtained  ualng  an 
automated  digital  acheme  and  to  thoae  which  ware 
maaaured  by  an  on-board  malog  computer.  Thla  atudy 
llluatratea  the  utility  <  f  modern  parameter  Identi¬ 
fication  techniquea  to  p lat-aimulatlon  analyala. 

I.  Inti  oductlon 

The  mathematical  modeling  of  pilot  reaponae  In  a 
particular  taak  la  of  continuing  lntereat  In  tha 
flalda  of  aircraft  devalopment  and  handling  quall- 
tlaa  evaluation.  A  model  which  can  accurately  rap- 
reaent  a  pilot 'a  rasporf*  -f  of  great  benefit  and 
can  ba  uaed  to  predl'  *  'Hot  rating  and  aircraft 
performance.  Amodtl  effort  auch  aa  thla  waa 
applied  to  a  recent  >t  >  •>  ualng  tha  Total  In-Flight 
Simulator  (TIPS)  to  Investigate  the  landing  approach 
handling  quailtiaa  of  a  larga  delta-wing  aircraft. 

HI. 

The  TIPS  la  a  variable  atablllty  raaearch  air¬ 
craft  which  permlta  tha  duplication  of  motion 
effacta  In  the  cockpit,  ea  wall  aa  vlaual  and 
Inatrumant  cuaa.  Crosawlnds  end  turbulence  can  ba 
Introduced  electronically  Into  the  evaluation  taak. 
Theae  algnela  era  recorded  to  provide  determlnlatic 
environmental  dlaturbances  which  cen  ba  uaed  later 
In  the  anelyala  program.  All  aircraft  states  and 
pilot  response  data  ere  also  recorded  on  a  digital 
tape. 


Describing  Function  Analyzer  end  Pitch  Paper  Pilot. 

II.  System  and  Disturbance  Models 

The  total  pilot-vehicle  system  for  tha  approach 
end  landing  task  of  a  large  dalta-wing  aircraft  can 
be  represented  by  Figure  1. 

Aircraft  Dynamic a 

The  longitudinal  dynamics  of  the  supersonic  trans¬ 
port  were  prograamed  on  the  TIPS  simulator  using 
linearized,  three-degsae-of- freedom,  smell  perturba¬ 
tion  equation*  of  motion.  Por  parameter  Identifica¬ 
tion  purposes  tha  longitudinal  responses  ware  simpli¬ 
fied  by  ualng  a  short  period  approximation  to  help 
limit  the  size  of  the  overall  model.  This  waa  a 
fairly  good  approximation  since  only  a  small  sactlon 
of  data  waa  being  analyzed  at  any  one  time  (40 
seconds)  and  ainca  approach  speed  waa  held  relatively 
constant. 

Tha  aircraft  short  period  linear  equations  uaed  In 
this  analyala  wera  of  the  form 

i  -  Ax  +  Bd 

For  the  short  period  approximation 

*  *  [*«  *.  q]T 

where 

6  pitch  angla  (rad) 
o  angle  of  attack  (rad) 
q  pitch  rate  (red/asc) 

The  aircraft  can  be  rapresanted  by  tha  following 
first  ordar  linear  differential  equations: 


Prior  to  conducting  this  experiment  e  praslmula- 
tlon  analysis  of  handling  qualities  was  performed 
ualng  Pitch  Paper  Pilot  [2],  This  analysis  provided 
the  predlctad  parameters  of  a  pilot  modal  for  pitch 
control  [3].  During  the  flight,  an  analog  computer 
known  as  a  Describing  Function  Analyzer  (DFA)  was 
used  to  measure  the  Sode  response,  (emplltuda  and 
phase)  of  the  human  operator  at  each  frequency  com¬ 
ponent  of  the  Input  forcing  function.  The  predic¬ 
ted  and  measured  pilot  parameters  were  then 
computed.  The  recorded  data  for  the  in-flight 
simulation  provided  a  data  base  from  which  a  tech¬ 
nique  could  be  developed  to  extract  pilot  model 
parameters  from  flight  test  data  records  by  applica¬ 
tion  of  parameter  Identification  techniques. 


q  -  (Mq  +  M4)q  +  (M^  + 
+  (M4Z6  +  Hs  )«, 


+  «4Z0  +  V  “gust 
,  +  V  +  V4e  +  Vgust 


From  the  above  aqua 'ion  it  can  be  sean  that 

B  -  10,  (M.  Z  +  M  ),  Z1T 

i  a  gi  a 


This  paper  will  describe  tha  models  of  the  air¬ 
craft,  the  flight  control  system,  and  tha  pilot  used 
Ju  the  post-aimulai:lon  analysis.  A  description  of 
'he  modified  Nawton-Raphson  parameter  identification 
routine  usad  to  extract  the  pilot  parameters  will 
also  be  discussed.  The  results  will  then  be  pre¬ 
sented  and  compered  with  Che  results  using  ths 


aid 

d  •  disturbance  vector  »  a 

gust 

The  disturbance  uaed  was  a  sum  of  five  sinusoids 
whosa  frequency  content  was  equally  spaced  when 
plotted  on  a  logarithmic  axis  [4].  The  power 
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distribution  reaeabled  that  of  a  Drydan  spectra  for 
an  angle  of  attack  guat,  a^gf.,  of  1.272  degrees, 
whose  associated  vertical  gust,  Wg,  was  6.0  ft/aec. 

The  disturbance  had  the  fora  and 


-ts  .  -(a  -  2/t) 
(s  +  2/t) 


“gust  (u)  -  l  An  ,ln  V 
n*o 

Figure  2  shows  the  power  dlatrlbution  of  this  dia- 
turbanca  (5]. 


I'll 
P  n 

then  the  hunap  operator  can  be  represented  by  four 
flrat  order  linear  differential  equations 


Control  -  Fael  System 

The  control  ayatea  for  this  an  ilysls  duplicated 
that  programmed  on  the  TIFS  [1].  Coupled  with  the 
control  ayatea  was  a  aecond  order  feel  ayatea  which 
provided  control  feel  to  the  wheel  and  rudder  pedals. 
The  total  control-feel  system  can  be  modeled  by  a 
fourth  ordar  linear  differential  equation.  This 
system  Is  shown  in  Figure  3.  Combining  these  two 
aocond  ordar  syatams  produces  the  following  transfer 
function) 

S  u  — - — _  s 

*  a*  +  SjB^  +  SjS2  +  a^a  +  a^  p 

Ueirtg  thrae  duomy  statea,  this'  equation  can  be 
transfarred  into  four  flrat  order  linear  differen¬ 
tial  equations  of  the  fora 
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♦  2  2  1 
7 2  ■  Ku  y  -25  «  T"  -u  6 
n  1  n  tr2  n 

>3  -  (-2/i)y3  +  (4/t)«' 


Total  Pitch  Tracking  Model 

Tha  total  pitch  tracking  model  can  be  represented 
in  the  state  vector  form  by 

k  -  Ax  +  Bd 


k  -  Ax 


where 


These  aquations  are 
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4  e  3e, 


*  -  (6.  a.  q.  «.  *  ,  rv  r2.  y3,  «')T 

2  3  4 

and  A  Is  a  partitioned  matrix  of  the  form  given  in 
Figure  5.  The  vectors  B  and  d  are  the  same  as  before. 

III.  Mewton-Kaphson  Minimization 

A  linear  ayatea  can  be  represented  by 

i  -  Ax  +  Bd 

and  a  set  of  output  expresslona 


Human  Operator 


y  »  Fx  +  Gu  +  b 


The  model 
quasl-1 Inear 


y>  ■ 


16],  [7]  and 

where  the  remnant  term  is  defined  to  be  that  portion 
of  the  actual  pilot's  response  not  accounted  for  by 
the  linear  model. 

The  linear  describing  function,  Yp(a),  can  be 
written  in  form 

x  ■  Ax 

by  representing  the  pure  tine  delay  by  a  first  order 
Pad!  approximation.  The  block  diagram  of  Figure  4 
represents  the  human  operator  model .  Using  the  Pad6 
approximation 


chosen  for  the  human  operator  is  a 
pilot  describing  function  of  the  form 


K  e'T*(T.a  +  1) 
P 


(TjS  +  1) 


.2  «„» 

+  —2-  -i-  lj 

hi  2  0)  1 

a  n 


18], 


and 


s  -  y  +  n 

In  the  above  equations 

x  state  vector 

’  calculated  response  vector 
s  measured  reaponse  vector 

d  disturbance  vector 

b  constant  bias  vector 

n  noise  vec  tor 

A  airframe/ gust  correlation  vector 

I  state  transition  matrix 

G  gust  tranaltlon  vector 

A  cost  function  which  la  proportional  to  the  mean 
square  error  can  be  represented  by 
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Because  the  aircraft,  feel  system,  and  control 
ay a tea  dynamics  are  known  quantities  (programmed  on 
the  TIFS  simulator  (1],  only  the  parameters  of  tha 
human  operator  are  identified.  These  pilot  para¬ 
meters  make  up  an  unknown  parameter  vector,  c,  which 
relates  to  the  system  states  and  system  responses  as 


n  noise  vector 


cQ  nominal  parameter  vector 
E  (nnT) 

M2  E{(c  -  cQ)  (c  -  co)T) 


*(t)  -  ft*(t),  c,  u(t)] 
y(t)  -  glx(t),  c]  +  q 

For  this  experiment 

C  -  l*/v  Vn*  Vn*  2/^]T 

a  TX 

The  estimate  for  these  parameters  can  ba  found  by 
t  -  ARC  MIN  (J) 

where  ARC  MIN  means  the  vector  c  which  minimises  tha 
coat  function  J. 

The  calculated  response  vector  y  can  ba  linear¬ 
ised  with  reapect  to  the  unknown  parameter  vector  c 
such  that 

*i  •  *i  +  Vi  (C  -  Co> 

o 

where 


where  E  is  the  expectation  operator.  This  occurs 
provided  the  weighting  matrices  used  are  equal  to  the 
appropriate  Inverse  error  covariance  matrices.  (The 
abova  information  taken  from  [9]). 

IT.  Program  Operation 

The  analysis  using  the  Newton-Raphson  method  [9] 
was  conducted  on  a  Control  Data  Cyber-74  computer. 

The  program  takes  56,000  words  of  central  memory  to 
compile  and  execute.  For  a  data  record  length  con¬ 
taining  400  data  points  of  11  state  variables,  the 
program  takes  approximately  3S0  seconds  of  central 
processor  time  and  25  seconds  of  peripheral  processor 
time.  Tha  program  has  the  capability  of  printing  out 
tha  values  of  the  gradient  and  RMS  error  of  each  state 
and  wuv  value  of  the  cost  function  at  each  iteration. 
After  convergence,  the  program  prints  out  the  final 
A,  B,  F,  and  G  matrices,  and  the  bias  vector  b.  Also 
printed  out  are  the  pilot  parameters,  an  error  covar¬ 
iance  matrix  of  the  estimated  results  and  their 
approxlaute  standard  deviation.  After  convergence  ia 
reached,  new  time  histories,  using  the  est luted 
matrices,  are  calculated. 


y^  nominal  response  calculated  by 

o  using  co 

V  gradient  of  y  with  respect  to  c 

c  nominal  c  vector 

o 

The  optimal  estimate  for  the  unknown  parameter 
vector  ia  the  vector  c  which  minimizes  J,  and  hence 
the  mean  square  response  error.  This  estimate  can 
be  found  by  applying  the  following  equation  itera¬ 
tively  to  update  the  calculated  nominal  response  and 
its  gradient  with  respect  to  the  vector  of  unknown 
parameters. 


A  priori  estimates  of  the  unknown  parameters  can 
be  Incorporated  into  the  cost  function  using  proba¬ 
bility  theory  [9],  [10],  Tills  is  done  by  maximizing 
the  unconditional  probabllicy  of  z.  The  optimum 
parameter  vector,  £,  will  result  if  a  cost  function 
containing  the  sum  of  the  mean  square  response  error 
and  the  mean  square  difference  of  c  and  Its  a  priori 
value  is  minimized. 


T.  Results 

Predictions  (Paper  Pilot) 

Tha  results  of  the  presimulation  analysis  using 
Paper  Pilot  [11],  with  a  pure  time  delay  of  t  >0.2 
seconds  and  a  first  order  neuromuscular  lag  of 
Tj  •  0.1  second,  predicted  a  pilot  lead  of  T^  ■  3.89 
srconds  and  a  pilot  gain  of  Kp  •  0.691.  These  para¬ 
meters  were  obtained  by  optimizing  the  pilot  para¬ 
meters  to  minimize  a  cost  functional  based  on  the 
root  mean  square  tracking  error  and  the  pilot  lead 
[21. 

Frequency  Techniques  (DFA) 

During  the  flight  test  of  the  TIFS  simulator,  the 
DFA  calculated,  on-line,  the  finite  Fourier  transform 
of  the  various  system  signals.  The  real  and  imaginary 
parts  of  the  Fourier  transform  were  then  used  in 
simple  off-line  calculations  to  yield  system  response 
and  performance  data.  Thu  rer  ilrlng;  describing  func¬ 
tion  measurements  can  be  seen  in  Table  1. 

Newton-Raphson  Method 

Using  the  aircraft  and  pilot  response  data,  which 
were  recorded  during  the  experiment,  the  Newton- 
Raphson  minimization  routine  was  used  to  extract 
pilot  parameters  based  on  the  theory  previously  dis¬ 
cussed. 
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During  the  digitization  of  this  data,  a  3-second 
section  of  deta  was  Improperly  digitized  midway 
through  tha  run.  Aa  a  result,  the  100  seconds  of 
data  we a  divided  Into  a  two  40  aacond  data  records 
and  aech  processed  separately.  During  the  Identifi¬ 
cation  anelysas,  the  natural  frequency  and  damping 
of  tha  second  ordar  neuromuscular  dynamics  were  set 
at  <1^  ■  16.5  redians/sac  and  £n  ■  0.12  [6]. 

The  Identified  pilot  parameters  In  Table  2  were 
obtelned  using  the  Newton-Raphson  technique . 

It  should  be  noted  that  thla  method  can  yield 
biased  estimates  If  the  mean  of  the  distribution  of 
6  is  non-zero.  This  bias  cnn  be  reduced  by  using 
tha  longest  data  records  possible.  The  Nawton- 
laphson  program  also  has  the  cepeblllty  of  estima¬ 
ting  the  bles  terms  of  each  of  tha  states. 

The  ebove  describing  functions  hava  been  plotted 
in  Bode  form  for  comparison  purposes.  These  plots 
appear  In  Figure  6. 

lamnant 

A  datafmlnetlon  of  remnant  wea  made  by  calcule- 
tlng  the  power  spectral  density  [12]  of  the 
difference  signal  formed  by  subtracting  the  pilot 
output  of  the  modal  from  the  ectual  recorded  pilot 
command  to  the  alavetor.  Figure  7  shows  the  power 
spectral  danalty  plots  of  tha  recorded  elavator 
command  of  tha  pilot,  the  modeled  elevator  command, 
and  the  celculetad  remnant. 

Aa  can  be  seen  from  a  cloaa  examination  of  the 
power  spectral  density  functions  of  tha  pilot  model, 
tha  model  produces  an  output  which  has  powar  at  aach 
of  the  five  Input  frequanclea.  The  spectral  danalty 
functions  of  tha  ectual  recorded  pilot  output,  how¬ 
ever,  has  power  at  frequencies  othar  than  those  of 
the  input.  Theae  extraneous  powers  ara  defined  as 


remnant  powers.  The  small  spikes  In  the  power  spec¬ 
tral  density  plots  could  rasult  from  nonlinear  or 
nonstationary  operation  of  the  pilot  or  from  the  fact 
that  the  approach  and  landing  tasks  requlrad  the  con¬ 
trol  of  soma  side  tasks  and  as  a  result  was  not  truly 
a  single  loop  compensatory  task.  The  large  spike  in 
eech  of  tha  remnant  plots  is  attributed  to  "pilot 
pumping".  Pumping  is  performed  by  the  pilot  to  obtain 
dynamic  Information  about  the  aircraft  as  It  anters 
ground  effects.  The  pumping  frequency  obsarved  from 
in-f light  records  wss  always  graater  than  1.0  radians/ 
sec.  This  oscillatory  Input  to  the  elevator  would 
aho*w  up  aa  a  pilot  generated  input  and  could  tharefore 
not  be  accounted  for  by  the  linear  daacrlblng  function. 
Making  a  sinusoidal  approximation  to  the  pilot  pump¬ 
ing  the  remnant  term  will  appaar  relatively  flat  and 
look  mora  like  a  typical  remnant  epactra. 

VI.  Development  Status 

To  dete,  the  Newton-Raphson  method  aa  eppllad  to 
pilot  modeling  has  only  baen  uaad  with  the  longltu- 
dlnel  dynemlca  of  a  lerge  transport  aircraft  simula¬ 
tion.  By  Including  the  lateral  directional  dynamics 
end  e  roll  p'lot  model,  a  two  axis  tracking  situation 
could  ba  mode  ad.  Also,  an  analytical  expression  for 
pilot  retlng,  such  ea  la  used  In  Paper  Pilot  [3],  or 
In  tha  Naal-Smlth  method  [14],  could  be  lncorporatad 
to  glva  not  only  identified  pilot  parameters,  but  also 
to  ralete  theaa  peramatars  to  e  useful  handling 
qualities  criterion. 

Flnelly,  tha  Nawton-Raphaon  method  could  be  used 
in  manual  control  situations  for  othar  than  aircraft 
sltuetiona,  such  as  eutomoblle  control  In  response 
to  highway  gusta  [15],  or  tha  behavior  of  a  helmsman 
steering  a  ship  [16]. 

Further  use  and  refinement  of  this  technique  could 
provide  e  valueble  tool  In  the  area  of  handling 
qualities  and  human  operator  modeling. 
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INTRODUCTION 


There  are  a  variety  of  approaches  to  describing  the  human  motor  control 
system.  One  is  to  describe  its  individual  components;  sensors,  controllers  and 
and  effectors,  in  order  to  assemble  them  into  a  realistic  model.  In  this  paper 
we  shall  consider  the  effector  organ,  skeletal  muscle,  and  one  series  of  experi¬ 
ments  for  identifying  and  measuring  muscle's  parameters. 

For  purposes  of  exposition,  it  is  helpful  to  consider  a  simple  visco-elastic 

fl  21 

model  of  muscle  illustrated  in  Figure  1  .  Such  a  model  makes  two  points. 

In  response  to  deforming  mechanical  forces,  muscle  acts  like  a  visco-elastic 

structure,  albeit  a  more  complex  one,  and  muscle  isi  also  a  force  generator  which 

is  filtered  by  its  own  internal  visco-elasticity. 

One  of  the  major  advances  in  muscle  physiology  was  the  recognition  that  any 

force  measured  externally  from  a  muscle's  attachments,  except  perhaps  during 

fused  tetany,  is  not  the  force  actively  generated  by  that  muscle's  intrinsic 

contractile  mechanism^.  The  difference  between  tho«e  two  forces  arises  as  a 

[31 

direct  consequence  of  the  mechanical  filtering'  J .  One  goal  of  research  into 
muscle  mechanisms  has  been  to  deduce  the  character  of  this  internal  force. 

Figure  2  dlagramatically  shows  that  force  as  well  as  the  externally  measured 

U1 

force  when  muscle  is  stimulated  to  p  single  twitch  contraction1  . 

Part  of  the  difficulty  in  studying  this  intrinsic  force  (which  of  course 
cannot  be  directly  measured)  is  that  the  properties  of  the  mechanical  filter 
are  not  accurately  known.  However,  it  is  well  established  that  the  visco¬ 
elastic  properties  of  muscle  are  not  invariant,  but  are  in  fact  a  function  of 

the  same  mechanisms  which  generate  and  control  active  contraction.  A  muscle 

[2  51 

which  is  contracting  is  much  stiffer  than  one  which  is  relaxed1  *  J. 

Knowledge  of  how  the  muscle  visco-elasticity  varies  with  contraction  is 
presently  limited  to  steady  state  conditions.  During  tonic  contraction,  both 


Che  elastic  and  the  viscous  stiffness  are  proportional  to  the  degree  of  contrac¬ 
tion^.  This  study  is  an  attempt  to  investigate  the  state  of  muscle  visco¬ 
elasticity  during  a  transient  muscle  contraction. 

METHODS 

The  subjects  (3  normal  adult  males)  were  seated  with  their  right  foot  strapped 
to  a  rigid  device  which  prevented  movement  of  the  foot  and  also  measured  torque 
about  the  ankle  joint. 

The  transient  contraction  was  produced  by  an  electrical  shock  of  1.5  msec 
duration  delivered  nercutaneously  to  the  posterior  tiblal  nerve  and  causing  a 
twitch  contraction  of  the  triceps  surae. 

Muscle  stiffness  was  measured  by  delivering  a  tap  to  the  achllles  tendon. 

The  force  measured  in  the  hammer  head  and  its  displacement  were  assumed  to  be 
directly  proportional  to  the  stretching  force  and  to  the  di0ree  of  stretch  Imposed 
upon  the  muscle. 

Fifty-five  twitches  were  elicited,  about  six  seconds  apart.  Once  during  each 
twitch  a  tap  would  be  delivered  to  the  tendon  and  the  hammer  force  and  displacement 
recorded  for  50  msec.  The  first  five  taps  were  delivered  prior  to  the  twitch  and 
the  last  50  at  increasing  intervals  after  the  start  of  the  twitch.  Figure  3  shows 
the  55  records  of  hammer  force  and  displacement  for  one  such  experiment. 

The  computation  of  stiffness  was  made  by  taking  the  difference  in  hammer  force 
at  75%  and  25%  of  its  peak  and  dividing  it  by  the  difference  in  hammer  displacement 
at  corresponding  instants  in  time.  These  Instants  were  determined  on  the  first 
hammer  blow  and  used  for  the  succeeding  fifty-four.  This  gave  the  ratio  of  force 
change  to  length  change  over  an  interval  of  from  6  to  10  msec.  The  tic  marks  on 
each  trace  of  Figure  3  indicate  the  points  actually  used  for  the  computation. 


RESULTS 


Figure  4  shows  the  change  In  relative  stiffness  over  a  400  msec  interval. 

On  the  same  time  scale,  the  muscle  twitch  is  also  shown.  All  the  data  is  nor¬ 
malized  to  fill  the  range  of  the  graph.  The  peak  stiffness  represents  an 
approximate  doubling  of  the  base  line  level.  Figure  5  shows  another  experiment 
in  which  the  subject  attempted  to  maintain  a  constant  level  of  muscle  contraction 
during  the  stimuli. 

DISCUSSION 

The  data  of  Figure  4  show  that  muscle  stiffness,  as  we  have  defined  and 
measured  it,  varies  along  a  time  course  that  is  similar  to,  but  slightly  faster 
that  the  muscle  twitch.  The  resemblance  between  the  shape  of  the  stiffness  curve 
in  Figure  4  and  the  intrinsic  tension  curve  in  Figure  2  is  most  striking. 

The  stiffness  in  Figure  5  also  varies  as  we  would  expect  if  it  were  produced 
by  the  same  mechanism  responsible  for  active  contraction.  In  that  experiment  the 
muscle  was  initially  contracted.  Under  such  conditions,  a  twitch  produces  a  brief 
period,  the  so-called  silent  period,  in  which  muscle  activity  is  reduced  by  means 
of  reflex  mechanisms.  In  such  a  case  we  expect  that  the  contractile  process 
shuts  off  briefly  even  though  the  external  tension  remains  above  the  initial  level. 
The  increase  in  stiffness  near  the  end  of  contraction  is  due  to  reactivation  of 
the  muscle. 

Although  such  data  are  promising,  a  number  of  cautionary  remarks  about  its 
interpretation  should  be  made.  An  obvious,  but  not  very  troublesome  shortcoming 
is  that  our  computation  of  stiffness  does  not  distinguish  between  viscous  and 
elastic  components  (and  in  more  realistic  models  than  Figure  1  there  may  be  several 
of  each).  This  does  not  invalidate  the  qualitative  implications  of  the  data.  For 
more  quantitative  information,  a  more  complex  approach  (such  as  finding  the  best 
solution  to  a  differential  equation)  is  needed.  For  a  preliminary  investigation 
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however,  it  was  felt  that  sophisticated  mathematical  techniques  were  premature. 

A  more  basic  problem  is  that  our  measure  for  stiffness  is  only  valid  under 
the  assumption  that  the  active  force  does  not  change  significantly  during  the 
Interval  over  which  the  measurement  for  stiffness  is  made.  That  this  assumption 
is  very  much  open  to  question  can  be  deduced  from  Figure  2,  especially  during 
the  initial  rising  phase  of  the  active  state. 

The  third  problem  is  in  relating  variables  measured  at  the  hammer  to  actual 
changes  in  muscle  length  and  tension.  We  have  assumed  a  linear  relation  over 
the  operating  range  in  these  experiments. 

It  is  worth  noting  however  that  this  very  simple  and  innocuous  experiment 
shows  promise  of  permitting  the  study  of  aspects  of  muscle  contraction  for  which 
there  are  currently  no  alternative  techniques. 
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Figure  3.  Records  of  hammer  force  (left)  and 
hammer  displacement  (right)  for  one  experi¬ 
ment.  The  length  of  each  record  Is  50  msacs. 

The  tic  marks  at  10  and  16  msecs  Indicate  values 
used  to  compute  stiffness  in  Figure  4. 


Figure  4.  Variation  in  stiff neaa  (  x  marks)  during 
a  tritch  contraction  (continuous  line)  with  triceps 
surae  muscle  relaxed  before  the  electrical  input. 
The  abscissa  is  time  from  0  to  400  msec.  The 
ordinates  are  uncalibrated.  The  relative  change 
in  stiffness  is  a  factor  of  two. 


Figure  5.  Variation  in  sti£fnesa  (x  marks)  during 
a  twitch  contraction  (continuous  line)  with  tri¬ 
ceps  surae  muscle  contraction  at  the  time  of 
electrical  input.  The  abscissa  is  time  from  0 


to  400  msec. 
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DETECTION  OF  A  CHANGE  IN  PLANT  DYNAMICS 
- IM  A  MaM-Ma&MME  gy§ T& - 


R.  J.  Niemela 

D.S.  Army  Avionics  Laboratory 
Fort  Momouth,  N.J. 


,  •  T>  to! 

,  ■  ^jrc.C 

n»  C»nW 


E.  S.  Xrendel 
University  of  Pennsylvania 
Philadelphia,  Pennsylvania 


ABSTRACT 


Description  of  man's  adaptive  behavior  in  a  closed- loop  system  requires 
a  model  of  the  means  by  which  the  human  operator  detects  the  change  in 
operating  conditions.  This  paper  describes  the  detection  portion  of  a 
concise  model  of  human  operator  adaptation  in  manually  tracking  a  step 
change  in  polarity  of  double  integral  plant  dynamics. 

The  general  form  of  the  detection  boundaries  in  error  state  space  was 
postulated  based  on  examination  of  man-machine  error  trajectory  responses. 
This  form  was  verified  and  the  actual  boundaries  determined  by  experimental 
data. 
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INTRODUCTION 


A  prime  reason  for  including  the  human  operator  as  an  active  element  in 
a  man-mac'.iine  system  is  to  make  use  of  his  adaptive  capabilities.  However, 
system  designers  are  restricted  in  the  employment  of  these  capabilities  by 
an  incomplete  understanding  of  man's  adaptive  characteristics  and  the  manner 
in  which  they  interact  with  the  system  parameters.  A  concise  mathematical 
description  of  man's  adaptive  behavior  similar  to  the  quasi-linear  model 
developed  for  steady-state  tracking  would  be  a  great  asset  to  man-machine 
system  design. 

Previous  research  efforts  [Sadoff  (1962),  Young  ( 196U) ,  Elkind  and 
Killer  (1967),  Phatak  and  Bekey  (1968),  and  Gilstad  and  Fu  (1970)]  have 
applied  a  diversity  of  analysis  and  modeling  techniques  to  the  problem  of 
human  operator  adaptation  to  sudden  changes  in  plant  dynamics.  These  previous 
efforts  resulted  in  several  general  conclusions  although  no  comprehensive 
models  have  emerged  for  human  operator  adaptation  to  a  step  change  in  plant 
dynamics.  A  thorough  survey  of  the  topic  is  presented  in  a  tutorial  article  by 
Young  (1969). 


APPROACH 


Human  operator  adaptation  to  a  step  change  in  plant  dynamics  can  be 
represented  by  a  variable  structure  system  model  (Niemela  1973).  The  current 
paper  describes  the  detection  aspect  of  this  model.  Due  to  the  incomplete 
understanding  of  human  operator  adaptation  the  current  effort  investigated 
the  following  task  :  human  operator  adaptation  in  a  one-dimensional,  com¬ 
pensatory,  visual  input  tracking  task  with  a  step  change  in  plant  dynamics. 

In  the  main  experiment,  the  subjects  were  well  trained  in  the  task  shown 
in  Figure  1.  The  input  was  low-pass  filtered  "white  noise"  with  equivalent 
statistical  bandwidth*  1.5  radians/second.  System  error  was  displayed  by  the 
lateral  displacement  of  a  dot  from  a  reference  line  on  a  raster  scan  cathode 
ray  tube.  The  control  stick  was  a  lightly  damped  single  axis  sidearm  con¬ 
troller.  During  the  course  of  a  two-minute  tracking  task,  the  polarity  of  the 
double  integral  plant  dynamics  was  suddenly  reversed.  The  subjects  were 
instructed  to  minimize  error  at  all  times  during  the  course  of  the  trails. 


*The  bandwidth  of  the  input  is  specified  in  terms  of  "equivalent 
statistical  bandwidth"  defined  as 

m  2 

w  .  C/0 

u,e  u/  1  1  71  *”  * 1 

/ 0  4^  (w)du> 

where  *ii(w)  is  the  power  spectrum  of  the  input.  This  quantity  has  been 
found  to  be  an  appropriate  measure  of  input  "randomness"  for  man-machine 
investigations  (McRuer  et  al.  1965,  Elkind  1961j). 
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figure  1.  Elements  of  Man-Machine  Investigation 


The  error  and  error  rate  are  the  difference  between  the  input  and  system 
output  and  their  first  time  derivatives: 


e(t)  ■  i(t)  -  m(t) 
e(t)  ■  i(t)  -  m(t) 

Upon  completion  of  the  experiment,  error  and  error  rate  for  time  just 
before  and  immediately  after  the  change  in  plant  dynamics  were  played  back 
on  an  X-Y  plotter.  Examination  of  the  error  trajectories  revealed  that 
during  steady-state  tracking,  the  error  trajectory  was  confined  to  a  region 
relatively  close  to  the  origin.  Immediately  after  the  change  in  plant 
dynamics,  the  error  increased  rapidly  until  the  subject  detected  the  change 
and  recovered  control,  figure  2  is  a  typical  error  trajectory  obtained  for 
the  double  integral  set  of  dynamics.  Examination  of  the  data  produced  in 
this  manner  revealed  several  dominant  features  of  the  error  trajectories: 
error  rate  peak  and  error  at  that  instant,  maximum  error,  and  the  second 
error  rate  peak  and  error  at  that  instant. 

Trajectories  similar  to  that  shown  in  figure  2  and  its  inverted  mirror 
image  appeared  with  approximately  equal  frequency.  For  ease  of  analysis  and 
discussion,  those  trajectories  in  the  second  and  third  quadrants  were 
normalized  to  appear  in  the  first  and  forth  quadrant.  It  was  found  that  the 
well-trained  subject  generated  error  time  histories  with  essentially  no 
overshoot  in  response  to  a  step  change  in  double  integral  plant  dynamics. 
This  observation  is  supported  by  averages  of  error  time  histories  compiled 
by  Elkind  and  Miller  (1967)  for  a  variety  of  plant  dynamics. 


THE  DETECTION  PROCESS 


The  manner  in  which  the  human  operator  detects  the  change  in  plant 
dynamics  is  of  prime  importance  :  this  detection  process  determines  the 
state  of  the  system  from  which  the  human  operator  must  recover  control. 


Figure  2.  Typical  Error  Trajectory  Response 


Numerical  data  is  presented  in  units  of  volts  and/or  volts/sec. 
Conversion  to  display  deflection  units  can  be  accomplished  with  the  factor 
.625  cm/volt. 


Detection  by  the  human  operator  was  manifested  by  an  abrupt  reversal  of  the 
manipulator  resulting  in  an  error  rate  peak.  It  is  evident  that  the  subject 
perceived  the  change  in  plant  dynamics  before  this  error  rate  peak  but  his 
reaction  time  delayed  his  response. 

Those  trajectories  in  the  data  set  which  displayed  a  very  small  excursion 
of  the  error  trajectory  from  the  origin  were  of  particular  interest.  Ex¬ 
amination  of  several  of  these  error  trajectories  indicated  that  the  human 
operator  did  not  perceive  a  change  in  dynamics  with  sizeable  errors  if  the 
velocity  is  toward  the  origin.  Futhermore,  it  appeared  that  detection  was 
accomplished  if  both  the  error  and  error  rate  were  sufficiently  large  in 
magnitude  and  identical  in  sign.  The  general  form  and  logical  representation 
of  the  detection  boundaries  implied  from  the  above  observation  are  shown  in 
Figure  3.  In  this  model,  a  change  in  plant  dynamics  is  detected  if  the 
error  trajectory  enters  the  crosshatched  region. 
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Figure  3*  General  Form  of  Detection  Boundaries 
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Recognising  that  the  human  operator  detects  a  change  in  plant  dynamics 
based  on  a  combination  of  error  and  error  rate,  the  manner  in  which  this 
detection  is  made  was  determined  through  construction  of  a  supplemental 
experiment. 

Elkind  and  Miller  (1967)  have  shown  that  if  the  subject  were  alerted 
by  a  1  kHz  audio  tone  the  instant  the  plant  dynamics  changed,  a  statistically 
significant  reduction  in  the  average  peak  error  resulted  in  the  postran- 
sition  transient  than  if  the  subject  had  to  deduce  the  failure  based  on  the 
error  alone.  Elkind  and  Miller  found  a  reduction  in  average  peak  error 
from  6.63  to  3.93.  This  reduction  was  significant  at  the  0.0J>  level. 

It  was  postulated  that  if  the  subject  were  alerted  when  the  error 
trajectory  intersected  computer  generated  boundaries,  the  location  of  the 
human  operator's  detection  boundaries  could  be  determined  by  examining  the 
average  peak  error  for  each  set  of  boundaries.  For  those  boundaries  which 
gave  no  improvement  over  the  nonalerted  case,  the  alerting  signal  was  redundant 
information  to  the  subject.  For  those  boundaries  which  gave  significant 
Improvement  in  average  peak  error,  the  alerting  signal  aided  the  subject  in 
the  detection  process. 

Two  methods  of  alerting  the  subject  were  investigated  in  preexperiment 
trials  -  visual  and  audio.  The  visual  means  consisted  of  a  small  white 
bar  which  was  displayed  to  alert  the  subject.  It  was  found  that  this 
indication  was  distracting  to  the  subject  as  has  been  noted  in  other 
experiments  involving  visual  alarms  (Poole  1966).  A  1  kHz  audio  signal 
similar  to  that  employed  in  Elkind  and  Miller's  investigation  was  Introduced. 
Mowbray  and  Gebhard  (1961)  found  that  the  human  operator's  response  to  audio 
alarms  is  quicker  than  visual  alarms.  Tbis  characteristic  of  audio  alarms  is 
fortunate  in  the  context  of  the  supplemental  experiment.  It  was  desired  to 
have  the  subject  aware  the  instant  the  error  trajectory  crossed  a  particular 
boundary. 

Prior  to  the  experiment,  the  subject  was  told  that  an  audio  tone  would 
be  provided  to  alert  him  of  a  change  in  plant  dynamics.  He  was  further 
instructed  that  the  mechanism  for  providing  the  "audio  alert"  wculd  not 
operate  in  an  identical  manner  from  one  trial  to  the  next.  Similar  to  the 
procedure  in  the  main  experiment,  the  subject  was  instructed  to  minimize 
tracking  error  at  all  times  in  the  course  of  a  trial. 

Table  I  contains  the  values  of  the  absolute  peak  errors  as  the 
detection  boundaries  were  varied.  The  detection  boundary  location  was 
specified  by  the  lower  left  comer  of  the  region  in  terms  of  multiples  of 
the  steady-state  RMS  error  and  FMS  error  rate. 
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'■"'■’•^^Treatment 

2 

3 

— 

9 

1 

8.0 

7.9 

12.9 

19.9 

12.9 

11.9 

2 

U.9 

12.0 

19.8 

12.8 

19.9 

9.9 

3 

lu8 

3.9 

8.9 

19.0 

11.9 

12.3 

U 

9.8 

10.0 

12.7 

10.2 

12.1 

9.9 

9 

6.1 

13.0 

11.6 

8.0 

10.9 

9.9 

6 

7.9 

8.9 

11.9 

lii.2 

9.9 

1U.9 

7 

8.9 

11.6 

lit  .9 

11.9 

1U.0 

8 

3.0 

7.9 

11.9 

9 

U.O 

9.0 

9.9 

10 

U.9 

8.2 

Naan  Absolute 

6.11 

9.08 

12.1 

12.6 

12.0 

11.9 

Peak  Error 

Treatment 

Number 

Detection  Region 

Comer  Location 
in  State  Space 
(Expressed  in 

Multiples  of  BIG 

Error  and  RMS  Error 
Rate) 

1 

(0,  o) 

2 

a.  i) 

3 

(2,  2) 

U 

(3,  3) 

9 

(3,  1) 

6 

(00,  00) 

Table  I.  Tabulation  of  Peak  Error  versus  Alerting  Boundaries 
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Six  sets  of  alerting  boundaries  were  considered  and  imiltiple  comparisons 
between  sets  of  boundaries  were  performed  to  determine  those  boundaries  which 
aided  the  subject  and  those  that  did  not.  Table  II  contains  the  elements  of  the 
Analysis  of  Variance  for  the  supplemental  experiment. 

Define | 

_  Absolute  peak  error  for  i^1  treatment 

ij  and  trial. 

Y  .  Y  :  Sura  o f  absolute  error  peaks  within 

•k  i  -  l  ^  treatments. 


n .  a 

l  J  i  y  :  Sum  of  absolute  error  peaks  across 

i  ■  1  J  ■  1  ^  treatments  and  trials. 


Table  II.  Elements  of  the  ANOVA 

Since  the  ratio  F  -  columns  ■  9. 71  is  greater  than  3.U8 

(M.S.)  error 

(F  for  $  x  h3  9  1%  level),  the  null  hypothesis  that  all  the  means  are  equal 
can  be  rejected  at  the  0.01  level. 

Sheffe's  (19!?9)  multiple  comparison  test  was  employed,  since  it  can 
accommodate  an  unequal  number  of  trials.  Application  of  Sheffe's  method  to 
the  present  experiment  was  adopted  from  discussionsby  McNemar  (1969)  and 
Edwards  (1965)  and  summarized  on  the  following  page. 


Define  the  following  variables: 

Zx^  :  Sun  of  absolute  peak  errors  for  1^  treatment 
k  :  Number  of  treatments 
n^  :  Number  of  trials  in  1^  treatment 
a^  :  Coefficient  of  weighted  average  of  the  j*'*1  treatment 
S*  ^  :  Error  mean  squared 


Any  two  sets  of  the  k  treatments  can  be  contrasted  through  use  of  the 
ratio  defined  as: 


P  - 


£2 _ 

2 


where. 


D  - 


subject  to  the  condition, 


J" 


k 

z  n.a, 
-1 J  J 


0 


The  calculated  value  of  F  is  tested  against  the  quantity  (k-l)F': 
F'  is  for  (k-1)  by  n  _  degrees  of  freedom  at  the  desired  level. 

3-i  j 


For  the  current  case  k  -  6, 


jU  ‘J 


1*9 


W  “-1 


Table  III  presents  the  contrasts  employed  to  determine  the  approximate 
location  of  the  detection  boundary.  The  elements  of  the  table  are  the  values 
of  aj  for  each  particular  contrast. 
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Contrast 

II- 
61.1 
iXj"  10 

X2- 

9o;8 

Hg*  10 

10^3 

n3-9 

>V  6 

X5- 
83.9 
n$-  7 

80.8 
“6"  7 

F 

1  vs.  2 

1 

-1 

7.58 

1  vs.  3 

9/19 

■00A9 

29.6  >12.1 

1  vs.  U 

6/16 

-10/16 

26.8  >12.1 

1  vs.  5 

7A7 

-1QA7 

2lwU>l2.1 

1  vs.  6 

7A7 

-10A7 

21.0  >12.1 

2  vs.  3 

9/19 

■40A9 

7.65 

2  vs.  U 

6/16 

-00/16 

7.85 

2  vs.  5 

7A7 

■40A7 

5.97 

2  vs.  6 

7A7 

■aoA7 

U.30 

U  vs.  6 

7A3 

■6A3 

0.582 

1  vs.  3,U, 

-1A0 

V5o 

1A5 

1/30 

1/35 

1/35 

38.9  >12.1 

5,6 

2  vs.  3,U, 

-lAo 

1/36 

1/2U 

1/28 

1/28 

11.3  >9.95 

5,6 

1&2  vs.  3 , 

-1/20 

-1/20 

3/36 

1/2U 

1/28 

1/28 

li0.2  >12.1 

U,5,6 

Table  III.  Multiple  Comparison  Tests 


Based  on  the  contrast  of  means  which  were  determined  to  be  significant. 
Table  IV  was  constructed.  All  the  contracts  were  significant  at  the  0.05 
level  with  the  exception  of  £2  vs.  3,U»5,6]  ,  which  is  significant  at  the 
0.1  level.  The  bars  group  means  which  were  found  to  have  a  significant 
contrast. 


significantly  reduce  average  peak  error.-  Thus,  it  is  reasonable  to  expect 
that  the  boundary  formed  by  the  logical  union  of  their  alerting  boundaries 
(Figure  5)  would  not  significantly  reduce  average  peak  error. 


Figure  $.  Union  of  Alerting  Boundaries  which  did  not 
Reduce  Average  Peak  Error 

By  defining 

Aj  !  alerting  boundary  associated  with  the  ith 
treatment 

It  is  seen  from  Figure  $  that 

A  •  ^  ^5*^6 

Similars  since  alerting  boundaries  for  Treatments  1  and  2  (Figure  6) 
did  significantly  reduce  average  peak  error,  the  boundary  formed  by  the 
union  of  those  two  alerting  boundaries  (Figure  7)  would  reduce  average  peak 
error. 


Figure  6.  Definition  of  Alerting  Boundaries  for  Treatments  1,  2 


e 


<re  2 <re  3a 

Figure  7.  Union  of  Alerting  Boundaries  which  did  Reduce 
Average  Peak  Error 


Therefore, 

A"  ■  ♦  Ag 


Hence,  the  human  operator's  detection  region  lies  between  these  two 
sets  of  alerting  boundaries  (Figure  8). 


Figure  8.  Approximate  Location  of  Human 
Operator's  Detection  Boundary 


CONCLUSIONS 


This  paper  has  defined  a  model  of  human  operator  detection  of  a  change 
in  plant  dynamics.  The  general  form  of  the  detection  boundaries  was  developed 
based  on  examination  of  man-machine  data.  The  form  of  these  boundaries  was 
verified  and  the  location  determined  through  an  analysis  of  variance  and 
multiple  comparison  tests  of  the  man-machine  data. 

The  location  and  form  of  the  detection  boundaries  defined  in  Figure  8 
does  not  imply  that  they  are  rectangular,  hyperbolic,  or  any  other  mathe¬ 
matical  form.  Subsequent  research  may,  however,  refine  the  location  and 
give  a  more  concise  representation  of  its  form. 

The  variables  employed  by  the  detection  model  could  be  monitored  in 
a  real  world  man-machine  system  to  provide  an  explicit  indication  to  the 
human  operator  of  critical  changes.  In  this  manner,  it  may  be  possible  to 
improve  the  safety  and  reliability  of  systems  in  which  man  and  machine 
operate  in  concert. 
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ABSTRACT 


A  method  for  directly  computing  sampled  data,  time  sharing,  thresholds, 
and  other  nonlinear  characteristics  of  the  human  pilot  has  been  developed 
and  applied  to  the  two  axis  example  of  VTOL  precision  hover.  The  task  is 
generated  by  a  model  of  pilot  induced  disturbances  including  crossfeed  and 
remnant.  After  the  model  was  optimized,  a  fixed  base  flight  simulation  was 
performed.  The  agreement  between  the  previously  computed  analytical  and  the 
experimental  data  shows  close  correspondence  in  all  system  variable  statistics, 
distribution  of  sampling  periods,  frequency  content,  and  ground  path  char¬ 
acteristics.  Direct  methods  were  used  to  identify  and  estimate  two  independent 
sources  of  inadvertent  crossfeed,  and  a  semi-direct,  or  Archimedean  method 
of  estimating  pilot  remnant  models  was  also  developed.  By  avoiding  lineari¬ 
zation  of  the  pilot  model,  many  effects  related  t"*  the  time  sharing  operation 
of  the  human  controller  have  been  studied  analytically.  Current  applications 
include  problems  of  weapon  delivery  and  loss  of  control. 


INTRODUCTION 

Historically,  the  development  of  mathematical  models  of  the  human  con¬ 
troller  has  been  based  upon  linear  continuous  operators,  such  as  the  Laplace 
transform.  This  formulation  lends  itself  to  ready  analysis  of  piloted  system 
stability  and  frequency  response,  and  the  great  progress  made  using  this 
approach  has  lead  to  the  development  of  pilot-vehicle  modeling  as  a  widely 
employed  and  established  discipline.  A  large  bibliography  now  exists,  and 
the  dynamic  properties  of  single  axis  time- invariant  human  control  are 
recorded  in  detail.  If  one  considers  the  problem  of  continuous  linear 
systems  driven  by  Gaussian  processes,  additional  performance  information 
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can  be  obtained,  since  the  input  and  output  power  spectra  are  related.  For 
a  zero  mean  process,  the  integral  of  the  output  spectrum  is  simply  the  mean 
square  of  the  time  history.  In  this  way,  time  domain  information  can  be 
obtained  for  problems  where  root  mean  square  (rms)  performance  must  be 
optimized. 

Under  contract  to  AFFDL*  Northrop  took  this  approach  to  define  methods 
for  predicting  and  evaluating  flying  qualities  in  turbulence.  These  studies 
are  reported  in  References  1,  2,  and  3, and  concern  attitude  stabilization  in 
bank  angle,  pitch  angle,  and  heading  as  single  axis  tasks.  The  method  was 
used  in  a  purely  predictive  manner  by  optimizing  the  gains  for  a  standard 
gain,  lead,  time  delay  pilot  model.  Figure  1,  reproduced  from  Reference  1, 
shows  the  comparison  between  moving  base  flight  simulation  data  and  the 
model  predictions  that  had  previously  been  submitted  to  the  Air  Force  Project 
Monitor,  Mr.  Frank  L.  George.  The  task  is  bank  angle  stabilization  and  each 
point  represents  a  different  aircraft. 

A  larger  study  to  validate  this  methodology  led  to  a  favorable  evaluation 
of  the  method's  accuracy.  These  statistical  data  are  given  in  Figure  2, 
from  Reference  2, and  include  64  F-5  and  A-7  flight  conditions  and  failure 
states.  Subsequent  to  this  research,  these  techniques  were  used  in  support 
of  several  Northrop  development  projects,  and  the  advantages  of  getting  time 
domain  information  out  of  the  pilot-vehicle  analysis  was  clearly  demonstrated. 


Figure  1.  Agreement  of  Predictions  with  Simulation 


*This  research  was  largely  carried  out  under  contracts  F33615-71-C-1077 
and  F3 3615-7 0-C- 1156  for  the  Air  Force  Hignt  Dynamics  Laboratory. 
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CONFIGURATIONS  AVERAGED 

AVERAGE  1  ERROR 

OF  PREDICTIONS 

X  RANGE  OF  PREDICTIONS 

Bank  Angle  Gust  Tracking 

Normal  Modes  Only 

13.35 

205 

Bank  Angle  Gust  Tracking 

Normal  and  Failure  Modes 

29.89 

389 

Figure  2.  Accuracy  of  Turbulence  Prediction 


Continuing  this  program  of  obtaining  time  domain  information  as  directly 
as  possible  from  the  piloted  system  models,  a  more  general  and  versatile 
handling  qualities  technology  has  been  produced.  Validating  examples  have 
been  obtained  and  one  of  them  -  the  VTOL  hover  problem  -  is  described  below 
along  with  a  general  account  of  this  new  approach. 

Although  linear  continuous  analysis  has  been  useful  for  design  and 
evaluation  applications,  it  has  not  led  to  sufficiently  comprehensive  studies 
of  large  scale  problems  such  as  time-varying  weapon  delivery,  and  loss  of 
control  at  high  angles  of  attack.  In  order  to  study  these  examples,  the 
total  system  model  must  contain  the  following  features: 


•Nonlinear  and  time-varying  aircraft  dynamics 
•Nonlinear  and  time-vatying  pilot  dynamics 

•Multi-axis  as  well  as  multiloop  pilot  operation  including  exact 
modeling  of  time  sharing,  sampling,  changing  criteria,  and 
threshold  effects 

•  Purely  predictive  adjustment  using  standard  optimization 

•  Easy  computational  methods  which  permit  the  modeling  of  large 

systems  with  gross  nonlinearities. 
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These  requirements  hsve  now  been  largely  met  using  the  following  two 
techniques: 

•  Direct  digital  simulation  as  a  handling  qualities  method 

•  Dynamic  (as  contrasted  to  statistical)  multi-axis  pilot  models 

that  employ  attention  and  control  shifting  criteria  called 
urzency  functions. 


The  VTOL  hover  problem  discussed  below  will  serve  to  illustrate  these 
concepts. 

DIRECT  DIGITAL  SIMULATION  AS  A  HANDLING  QUALITIES  METHOD 


Since  the  Fourier  transform  only  partitions  the  set  of  autocorrelation 
functions  into  classes,  each  of  which  is  represented  by  a  single  power 
spectrum,  it  is  not  a  one-to-one  mapping  of  dynamical  problems  into  the  class 
of  power  spectra.  In  other  words,  time-varying  problems,  discrete  time 
points,  and  most  nonlinearities  are  not  preserved  by  the  Laplace  or  any 
other  linear  transform,  even  if  characterized  by  a  continuous  operator. 

Thus  for  such  problems,  the  concept  of  eigenvalues  loses  its  meaning  and  one 
is  forced  to  find  useful  parameters  in  the  time  domain  where  these  system 
properties  naturally  exist.  The  way  to  do  this  is  by  directly  generating 
the  time  series  corresponding  to  the  dynamics  of  Interest  and  performing 
analysis  on  the  records  produced.  This  approach  has  been  extensively  used 
to  analyze  the  nonlinearities  of  limits,  thresholds,  hysteresis,  and  other 
questions  of  controls  design,  and  the  techniques  for  doing  this  kind  of 
computation  are  generally  known. 

Although  digitil  simulation  has  its  share  of  traps  and  pitfalls,  the 
method  of  Z-transforms  and  difference  equations  has  proved  to  be  practical; 
the  entire  system  can  be  modeled  directly  with  no  linearizing  assumptions 
on  either  the  pilot  or  the  aircraft  with  its  control  system.  Furthermore, 
digital  simulation  programs  have  been  produced  that  are  very  rapidly  adapted 
to  new  problems,  and  readily  available  computers  ensure  accuracy  and  speed, 
both  of  which  are  necessary  for  general  usage  of  the  method.  The  specific 
application  of  digital  simulation  to  handling  qualities  problems  is  a  tech¬ 
nology  of  its  own  and  has  undergone  a  rapid  development  at  Northrop  during 
the  last  two  years,  but  the  most  dramatic  success  of  digital  simulation  has 
been  in  the  study  of  directly  (as  contrasted  to  statistically)  modeled 
multi-axis  piloted  control. 

To  sum  up,  digital  simulation  as  a  handling  qualities  method 

•  is  Inexpensive  and  easily  applied, 

•  allows  the  exact  modeling  of  the  system  and  the  task, 

•  provides  a  method  for  applying  a  faithful  multi-axis  pilot  model 

to  handling  qualities  problems. 


Digital  simulation  technology  has  been  available  for  some  time.  What  is 
needed  is  the  multi-axis  pilot  model. 
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THE  MULTI-AXIS  HUMAN  CONTROLLER 


A*  mentioned  above,  e  greet  deel  is  known  ebout  the  dynamics  of  the 
human  pilot  performing  continuous  linear  tasks  on  a  single  axis,  including 
multiloop  tasks.  Much  work  has  gone  into  developing  models  that  match 
the  amplitude  and  phase  characteristics  of  the  pilot's  output  at  the  con¬ 
troller,  and  many  aspects  of  the  internal  structure  of  the  human  have  been 
analyzed.  These  "ultra-precise"  models  are  of  use  in  solving  many  human 
factors  problems  about  the  interface  between  pilot  and  controller,  but  for 
the  basic  objective  of  determining  the  total  system  dynamics,  it  is  usually 
sufficient  to  employ  simple  models  that  consist  of  gain  K  ,  lead  T^,  time 
delay  T,  and  possible  lag  T^:  ^ 
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The  more  exact  pilot  models  can  certainly  be  employed,  but  for  most  purposes 
the  above  simple  model  gives  good  statistical  results. 

There  have  been  three  main  approaches  previously  taken  in  attempts  to 
extend  single  axis  model  theory  to  multi-axis  tasks.  All  of  these  recognize 
that  the  human  must  operate  as  a  time  shared  device  when  faced  with  difficult 
control  tasks  on  several  Independent  axes.  This  intermittent  operation 
degrades  the  performance  of  each  axis  from  what  the  pilot  would  achieve  in 
continuous  control.  As  might  be  expected,  these  three  approaches  are 
1)  decrease  the  model  gain  from  the  optimum  for  continuous  control,  2)  in¬ 
crease  the  time  delay  to  account  for  the  periods  of  inattention,  and  3) 

Inject  filtered  noise  to  imitate  the  spectral  content  of  the  shifting  pilot 
control.  In  many  cases  these  methods  have  matched  data  already  obtained  from 
flight  simulation,  but  they  have  never  been  used  to  predict,  before  the 
experiment,  the  statistics  of  any  broad  class  of  aircraft  dynamics. 

The  problem  with  these  three  approaches  is  thisi  the  human  pilot  is 
quite  discriminating  about  when  he  will  abandon  the  control  of  one  task  to 
take  over  the  control  of  another.  This  leads  to  a  sampling  criterion  that 
is  functionally  dependent  on  the  total  system  variables.  In  no  way  can  this 
be  regarded  as  a  purely  random,  or  a  regular  sampling.  Thus  a  multi-axis 
pilot  model  must  contain  an  algorithm  that  determines  when  control  shifting 
takes  place,  and  the  model  must  be  computed  in  a  way  that  preserves  this 
information.  Recently,  Northrop  developed  a  multi-axis  pilot  model  which 
does  just  that,  the  urgency  function  model. 

By  using  the  method  of  digital  simulation,  the  exact  functional  cri¬ 
terion,  by  which  a  pilot  decides  his  control, can  be  directly  computed  without 
the  gross  distortions  of  linearization.  The  development  of  the  form  of  these 
urgency  criteria  has  now  advanced  to  the  point  where  they  can  be  determined 
from  1)  the  system  dynamics,  2)  the  task,  and  3)  the  appropriate  human 
factor  information  about  the  pilot. 


Let  x^  be  the  state  variables  of  one  axis  of  a  two  axis  task,  and  let 
the  other  axis  be  represented  by  y..  Then  the  control  criterion  is  satis* 
fled  identically  with  the  inequality 
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where  U  and  Uy  are  the  urgency  functions  of  the  x  and  tht:  y  axes.  These 
functions  are  always  nonlinear  in  the  statf.  variables,  but  fall  into  several 
precise  classes.  Some  of  these  classes  have  been  well  explored,  and  a  full 
tabulation  of  the  urgency  functions  will  appear  later. 

The  multi-axis  urgency  function  model  thus  consists  of  simple  linear 
dynamics,  equation  (1),  along  with  the  control  criterion  of  (2).  Whichever 
axis  has  the  larger  urgency  function  gets  the  corrective  control  attention. 
The  adjustment  of  the  linear  coefficients  can  usually  be  obtained  (the  hover 
problem  was  an  exception)  by  an  easy  search  starting  with  the  optimum  single 
axis  coefficients.  Almost  always,  the  optimum  multi-axis  coefficients  differ 
significantly  from  these  values,  especially  in  multiloop  control  on  the  two 
axes. 

Before  the  VTOL  example  can  be  presented,  there  is  another  topic  essential 
to  the  understanding  of  multi-axis  control!  pilot  Induced  noise.  In  the 
continuous  single  axis  case  this  noise  is  defined  to  be  the  linearly  uncor¬ 
related  part  of  the  pilot's  output  and  is  called  remnant.  It  consists  of 
white  noise  mechanically  filtered  by  the  muscle  actuation  system  and  arm- 
controller  dynamics.  Physically,  this  represents  a  blend  of  three  sources 
of  error  in  the  pilot's  response!  observation  noise,  Internal  processing 
error,  and  actuation  noise.  For  multi-axis  tasks  there  is  another  source, 
Inadvertent  crossfeed. 

If  one  obtains  an  x-y  plot  of  lateral  and  longitudinal  stick  for  a  two 
axis  tracking  task,  the  results  show  not  only  the  split  control  (the  lines 
going  mainly  up  and  down,  and  left  to  right  like  a  small  town  street  map) 
but  also  Inadvertent  control  Inputs.  In  a  task  where  there  is  zero  mean 
control  deflection,  the  pattern  la  similar  to  Figure  3  obtained  from  a 
Northrop  simulator. 


Figure  3.  Cross  Plot  of  Lateral  and  Longitudinal  Stick 


If  one  ignorea  the  small  amount  of  time  the  trace  ia  outside  the  cross  drawn 
on  the  figure,  it  is  apparent  that  the  controller  motions  are  distributed 
about  an  ideal  motion  which  would  coincide  with  the  axes.  This  inadvertent 
crossfeed  noise  has  two  sources  as  shown  in  Figure  4,  and  using  the  method 


By  using  previously  obtained  x-y  stick  plots  for  various  tasks,  the 
amount  of  the  crossfeed,  bias  and  skewness,  can  be  estimated  with  sufficient 
accuracy.  If  the  system  under  study  is  driven  by  a  large  input  such  as  a 
command  tracking  task  or  aerodynamic  disturbance,  the  effect  of  these  error 
sources  may  be  small.  However,  in  difficult  tracking  tasks  where  the 
principal  disturbance  is  the  pilot  himself,  the  remnant  and  the  crossfeed 
have  overwhelming  influence  on  the  system  performance. 

Now  that  the  two  multi-axis  sources  of  pilot  induced  noise  have  been 
Joined  to  the  urgency  function  pilot  model  described  above,  the  VTOL  hover 
problem  can  be  discussed. 


A  SELF-GENERATED  TWO-AXIS  VTOL  HOVER  TASK 


In  order  to  demonstrate  the  operation  of  all  features  of  the  urgency 
function  pilot  model,  a  problem  was  selected  that  is  perhaps  the  most  diffi¬ 
cult  case  of  any  yet  encountered  or  contemplated.  The  analysis  of  this  pro¬ 
blem  proceeded  by  estimating  the  remnant  and  the  crossfeed, and  optimizing 
the  linear  coefficients  and  the  urgency  functions  for  a  standard  time  delay 
of  .3  seconds.  The  analysis  showed  the  importance  of  all  aspects  of  the 
model,  and  once  completed,  a  flight  simulation  was  performed. 
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The  vehicle  is  essentially  a  fourth  order  integration  of  each  (lateral 
and  longitudinal)  axis.  The  task  is  to  hover  as  close  to  the  origin  as 
possible  in  still  air;  there  are  no  external  disturbances.  Thus  the  task 
for  the  pilot  is  two-axis  multiloop  control  disturbed  only  by  remnant, 
crossfeed,  and  urgency  function  svltchln£. 

A  block  diagram  of  the  digital  simulation  of  this  problem  is  given  in 


Explicitly,  the  linear  parts  of  the  pilot  models  consist  of  inner  loop 
attitude  control  and  outer  loop  position  control.  The  urgency  functions 
take  position,  velocity,  attitude, and  attitude  rate  into  account.  These 
control  laws  are  as  follows,  where  the  subscript  "P"  indicates  longitudinal 
quantities,  and  "R"  lateral: 
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Before  the  experimental  results  are  given,  there  are  a  few  aspects  of 
the  model  performance  that  should  be  discussed.  The  adjustment  of  the 
coefficients  for  this  study  is  by  far  the  most  difficult  case  yet  encountered 
and  turned  out  to  be  sensitive  to  both  the  form  and  the  values  of  the  urgency 
functions.  The  correct  form  of  Up  and  Up  were  derived  without  much  trouble, 
but  a  parameter  search  had  to  be  made  for  the  coefficients.  Once  stable 
hovering  was  achieved  -  which  incldently  is  not  possible  with  regular  or 
random  sampling  •  a  manual  gradient  method  was  used  to  simultaneously  adjust 
both  the  linear  and  the  urgency  coefficients.  This  was  done  by  using  an 
on-line  graphical  computer  terminal.  The  model  was  optimized  for  minimum 
rms  position  error.  For  non-optimum  urgency  function  forms,  the  vehicle 
would  orbit  the  origin  a  few  times  then  spiral  outwards  unstable;  for  non¬ 
optimum  urgency  coefficients,  the  hovering  was  stable,  ied  to  rapid  switching 
and  had  other  unrealistic  features  of  the  ground  path  traces.  The  remnant 
level  was  adjusted  from  previous  analysis  and  simulation;  the  novel  method 
for  doing  the  remnant  calibrations  will  be  discussed  later. 

The  experimental  work  was  undertaken  after  the  analysis  of  this  hover 
problem  was  complete.  The  model  had  been  optimized,  and  many  other  attempts 
to  improve  its  performance  by  varying  the  urgency  functions  did  not  succeed. 
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The  simulation  facility  was  a  fixed  base  arrangement  using  a  side-arm 
controller,  a  dual  beam  oscilloscope  display,  and  analog  computation.  The 
gain  on  the  display  was  increased  to  the  point  that  pilot  induced  noise 
served  to  drive  the  pilot-vehicle  system.  This  required  high  gains  in  the 
equipment,  and  considerable  effort  was  made  to  maintain  good  signal  to 
noise  ratios  and  prevent  cross-talk  on  the  patchboard.  The  display  consisted 
of  an  illuminated  dot  representing  ground  position,  and  an  illuminated  line 
that  gave  attitude  information  as  shown  in  Figure  7. 


Horizon  Line 


Figure  7.  VTOL  Hover  Simulation  Display 


The  subject,  a  former  Navy  test  pilot,  determined  the  optimum  control 
sensitivities  and  was  asymptotically  trained.  Data  were  taken  for  a  total 
of  twenty  trials  of  100  seconds  duration.  The  data  from  the  simulation  are 
tightly  clustered  and  show  only  a  slight  learning  trend  during  the  final  ten 
trials.  A  comparison  between  the  model  and  the  simulation  ground  paths  is  shown 
in  Figure  8,  each  drawn  to  the  same  scale. 


These  ground  path  traces  show  many  similar  qualitative  features,  absent  in 
the  non-optimum  model,  such  as  the  sharp  points  and  tight  turns  where  the  pilot 
nearly  stops  the  translation  of  the  airplane  in  order  to  initiate  a  better 
velocity  vector.  The  similar  size  and  shape  of  the  loops  indicates  similar 
spectral  content.  Figure  9  shows  a  segment  of  the  time  history  of  pitch 
angle  as  generated  by  the  model  and  by  the  simulation. 


0  Model 


0  Simulation 


Figure  9.  Theta  Time  His<  ories  from  Model  and  Simulation 


The  switching  times  produced  by  the  model  and  by  estimation  from  the 
strip  chart  recording  of  the  lateral  and  longitudinal  stick  are  compared  in 
the  following  histograms,  Figure  10,  which  show  the  mean  sample  period  to  be 
between  1.5  and  2.0  seconds.  These  statistics  are  combined  from  lateral 
and  longitudinal  data  since  the  dynamics  of  the  two  axes  are  identical. 


Total 


Total 


Simulation 


Model 


Figure  10.  Histograms  of  Pilot  Switching 
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The  most  telling  comparison  of  the  urgency  function  model  end  the  flight 
simulation  is  in  the  statistics.  These  ere  shown  in  Figure  11. 
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Figure  11.  Comparison  of  Model  and  Simulation  Statistics 


This  agreement  of  the  model  and  the  simulation  completes  the  compari¬ 
sons  for  the  VTOL  example.  In  retrospect,  there  seems  to  be  no  area  where 
the  model  has  failed  to  be  accurate  in  statistical,  spectral,  or  qualitative 
features.  Currently  more  general,  or  representative  VTOL  system  models  are 
oeing  investigated,  but  the  model  has  required  no  further  modifications. 

The  next  generalization  of  this  problem  is  the  time  varying  problem  of  VTOL 
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handling  qualities  during  transition.  By  usina  the  dieital  .  . 

problem1?  *5*  urgency  functlon  “ulti-axis  pilot  model,  this  time-varyin?™*0 
problem  can  be  approached  in  its  full  generality.  y  8 


ANOTHER  MULTI-AXIS  EXAMPLE 


two-.xi.°?Ick?ff0f?in  fUrther  •x"nPles  *nd  validations,  data  from  several 
two  axis  tracking  tasks  were  surveyed  and  analysed.  The  problem  given  here 
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Figure  12.  Urgency  Function  System  Model 
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The  comparison  of  the  urgency  function  model  with  the  Wanamaker- Sower 
data  is  given  in  Figures  13  through  18. 
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Figure  14. 
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Figure  18. 


Examples  of  time  histories  of  the  tracking  command  and  the  response  of 
the  two-axis  model  is  given  in  Figure  19. 


Figure  19.  Time  Histories  of  Model  Response 
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A  summary  of  these  six  ceses  is  given  in  Figure  20  which  compares  the 
model  with  the  Wanamaker- Sower  simulation  data. 
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Figure  20.  Comparison  of  Urgency  Model  with  Simulation  Data 


Currently, these  results  are  being  enlarged  by  including  extentions  of 
the  Wanamaker- Sower  research  as  contained  in  an  AFIT  thesis  by  Machuca  and 
Lind  which  studies  lateral  and  longitudinal  F-4  dynamics.  Many  cases  of  this 
kind  have  been  already  analyzed  using  the  urgency  function  multi-axis  pilot 
model,  and  further  Northrop  simulation  is  now  in  progress. 
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REMNANT  MODELING  AND  CALIBRATION 


Remnant  is  defined  for  continuous  tracking  to  be  the  linearly  uncor¬ 
related  part  of  the  pilots  output.  Spectrally,  it  is  white  noise  attenuated 
through  the  mechanical  filtering  of  the  arm  and  controller  dynamics.  Since 
many  tasks  are  primarily  disturbed  by  the  pilot  himself,  it  is  essential  to 
have  a  way  of  determining  by  the  most  simple  and  direct  method  possible 
1)  whether  the  assumed  spectral  shape  of  the  remnant  is  appropriate,  and  2) 
what  amplitude  the  remnant  should  be  given  in  the  model.  In  order  to  do 
this  for  the  VTOL  hover  problem,  a  method  for  calibrating  remnant  was  developed 
that  can  be  readily  used  in  any  control  situation.  It  also  provides  a 
rough  check  on  the  correctness  of  the  spectral  shape  in  terms  of  the  statis¬ 
tical  performance  of  the  piloted  system. 

The  method  is  essentially  Archimedean,  and  the  way  it  was  developed  is 
as  follows:  If  a  pilot's  actual  remnant  were  an  accessible  quantity,  the 
remnant  amplitude  could  be  altered.  Thus  one  could  determine  the  unknown 
remnant  level  by  simply  turning  it  down  until  the  system  error  vanishes; 
the  amount  of  reduction  would  be  equal  to  the  original  remnant.  A  second 
glance  at  this  reveals  that  one  doesn't  need  to  turn  the  pilot's  remnant 
down,  since  the  slope  of  the  line  and  the  point  of  the  unaltered  performance 
will  suffice  to  determine  the  intercept  at  zero  tracking  error.  At  this 
point  it  becomes  apparent  that  the  pilot's  remnant  can  be  increased  experi¬ 
mentally  by  adding  noise  of  the  right  spectral  shape  to  his  output  and  by 
measuring  the  change  in  tracking  performance  the  slope  can  be  found.  This 
method  is  diagrammed  in  Figure  21. 


Tracking  Error 


Figure  21.  Remnant  Model  Calibration  Method 
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This  method  has  been  employed  to  calibrate  the  remnant  levels  for  not 
only  the  VTOL  hover  task  detailed  above,  but  two-axis  attitude  stabilization 
tasks  as  well.  Figure  22  shows  the  experlemntal  data  for  an  attitude  stabi¬ 
lization  task  with  incremented  remnant.  Each  data  point  represents  a  100 
second  simulation. 


Figure  22.  Experimental  Remnant  Calibration  Data 


The  white  noise  used  for  this  simulation  of  remnant  was  filtered  by  a 
40db/decade  filter  with  a  time  constant  of  .1  seconds.  In  this  case  the 
model  was  statistically  appropriate  since  the  data  form  a  straight  line 
through  the  base  point  where  no  artificial  remnant  is  added.  (To  see  this 
consider  a  100  Hz  component  of  mls-modeled  remnant.  This  would  displace 
the  incremented  remnant  data  to  the  right,  and  a  kink  would  show  in  the  data.) 

Although  this  method  of  modeling  remnant  with  noise  injection  is  useful, 
newer  methods  have  been  developed  at  Northrop  and  are  now  going  into  use. 

If  one  considers  the  physical  sources  of  remnant,  there  are  three  contribu¬ 
tions.  The  first,  observation  error,  is  modeled  by  using  available  human 
factor  data  to  randomize  the  information  going  to  the  pilot  model.  This 
corresponds  to  various  threshold  and  discrimination  limits  of  the  human  in 
a  given  control  environment.  The  second,  internal  human  data  processing,  is 
modeled  by  perturbing  the  constants  (gain,  lead,  and  delay)  of  the  linear 
model.  The  final  source  of  remnant  is  human  actuation  noise.  Here  again 
human  factor  data  are  used  to  estimate  the  accuracy  of  control  positioning 
and  the  actuation  noise  is  modeled  by  randomization. 

In  this  way,  the  fundamental  program  of  replacing  statistical  models 
of  the  human  controller  by  dynamlt  models  becomes  complete. 
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APPLICATIONS  AND  FURTHER  RESEARCH 


Since  these  methods  of  digltsl  simulation  and  multi-axis  pilot  models 
allow  large  scale  maneuvers  to  be  studied  as  the  closed  loop  nonlinear  and 
time-varying  problems  that  they  are,  there  are  a  large  number  of  applications 
which  can  be  undertaken.  The  following  is  just  a  sample  of  the  scope  of 
problems  now  possible.  Northrop  is  currently  working  on  several  major 
examples,  and  further  work  will  include  as  diverse  a  collection  as  possible. 

WEAPON  DELIVERY 


Both  air-to-air  and  air-to-ground  problems  can  be  studied.  In  dive 
bombing,  for  example,  the  analysis  includes  target  acquisition,  roll-in, 
acquisition  of  the  glide  slope,  tracking  using  the  weapon  sight,  intense  but 
briefly  unstable  attitude  rate  stabilization  prior  to  weapon  release,  and 
pull  up.  The  entire  maneuver  can  be  digitally  "flown"  many  times  in  the 
presence  of  the  realistic  environment  of  low  level  turbulence  and  pilot  in¬ 
duced  system  noise,  and  the  statistics  of  impact  error  produced. 

CARRIER  LANDING  APPROACH 

The  aerodynamics  of  carrier  approach  are  not  well  represented  by  con¬ 
stant  coefficient  linear  uncoupled  dynamics.  Furthermore,  the  landing  task 
in  the  presence  of  low  level  turbulence  and  carrier  roll  and  heave,  make  the 
use  of  the  exact  nonlinear  models  of  the  problem  necessary.  Much  has  been 
learned  from  linear  methods  about  the  form  of  the  control  strategy  that  the 
pilot  must  Use,  and  the  study  of  the  behavior  of  the  multi-axis  pilot  model 
can  utilize  this  information  to  produce  a  comprehensive  analysis  of  the 
entire  maneuver. 

VTOL  HANDLING  QUALITIES 

The  hover  problem  discussed  above  is  just  an  illustration  of  the 
application  of  multi-axis  pilot  models  to  the  study  of  VTOL  hsndling  quali¬ 
ties.  The  most  interesting  problem  is  to  Investigate  the  handling  qualities 
of  the  nonlinear  vehicle  from  hover  through  transition. 

COORDINATION  OF  ANALYSIS  AND  FLIGHT  SIMULATION 


The  multi-axis  pilot  model  technologies  developed  at  Northrop  will  not 
replace  piloted  flight  simulation,  but  in  fact  can  be  used  to  greatly  improve 
its  efficiency.  Not  only  will  consistent  analytical  and  experimental 
results  give  greater  credibility  to  both,  but  the  ability  to  screen  away 
needless  experiments  by  analysis  will  also  improve  the  overall  efficiency  of 
aircraft  evaluation  and  design. 

LOSS  OF  CONTROL  AT  HIGH  ANGLES  OF  ATTACK 


Once  aerodynamic  descriptions  of  this  flight  condition  are  determined, 
the  nonlinear  and  time-varying  modeling  capabilities  of  the  Northrop  methods 
can  be  immediately  applied.  The  multi-axis  pilot  models  required  will  be 
similar  to  the  ones  developed  for  attitude  stabilization.  As  an  example, 
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The  ultimete  objective  of  handling  qualities  specification  is  to 
ensure  acceptable  performance  of  piloted  aircraft.  Most  often  the  only 
way  to  determine  criteria  is  to  hunt  for  physical  aircraft  characteristics 
that  correlate  strongly  with  desired  system  response.  Historically, 
this  has  proved  to  be  valuable  for  a  large  class  of  operational  aircraft. 
Documents  such  as  MIL-F-8785B  "Military  Specification  of  Flying  Qualities 
of  Piloted  Aircraft"  and  the  Background  and  Users  Guide  have  been  invaluable 
not  only  for  aircraft  evaluation,  but  also  as  a  guide  to  preliminary  design 
and  the  entire  process  of  achieving  a  final  system  configuration.  However, 
the  advent  of  high  authority  control  systems,  control  configured  technolo¬ 
gies,  and  the  great  premium  on  high  performance  vehicles  gives  much  greater 
freedom  to  the  range  of  basic  airframe  designs  and  control  configurations. 
Consequently,  many  new  kinds  of  systems  are  under  development  that  may  not 
be  expected  to  fit  the  pattern  of  past  aircraft  and  their  associated 
parameter  correlations  with  good  pilot  ratings. 

In  order  to  fill  this  broadened  specification  requirement,  newer 
technologies  that  take  into  account  the  total  pilot-vehicle  system  must 
be  utilized.  The  use  of  linear  pilot  model  theory  in  problems  of  pilot 
induced  ocsillations  (P10)  certainly  demonstrates  the  importance  of  such 
analysis,  but  the  possibilities  now  go  significantly  further.  By  directly 
modeling  the  specific  missions  that  a  system  is  designed  to  perform,  as 
well  as  the  general  performance  during  all  phases  of  operation,  it  is 
possible  to  obtain  a  comprehensive  analytical  assessment  of  the  piloted 
flying  qualities.  Once  the  methods  of  linear  pilot  theory,  digital 
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simulation,  and  urgency  function  multi-axis  pilot  models  era  generally 
used  and  experience  is  gained  in  their  application,  the  realization  of 
more  definitive  handling  qualities  criteria  will  follow. 


FINAL  REMARKS 


The  above  discussion  is  but  a  survey  account  of  Northrop  research 
into  urgency  function  pilot  models  and  digital  simulation  as  a  handling 
qualities  method.  However,  the  examples  presented  above  do  illustrate  the 
way  in  which  the  entire  system  can  be  modeled  and  evaluated.  There  is 
a  wealth  of  additional  information  that  has  been  generated  during  the 
last  several  years  Indicating  many  areas  of  pilot  dynamics  and  task  inter¬ 
action.  Some  of  these  properties  appear  to  be  candidates  for  specification, 
and  others  indicate  that  substantial  gains  in  piloted  performance  can  be 
achieved  in  multi-axis  optimization  of  many  systems  where  the  associated 
single  axis  tasks  are  well  behaved. 

The  coupling  of  lateral  and  longitudinal  tasks  through  the  pilot 
as  well  as  the  nonlinear  airframe  in  problems  of  landing  approach,  weapon 
delivery,  and  control  at  high  angles  of  attack  warrant  an  extensive 
Investigation  of  nonlinear  pilot-vehicle  technologies.  Northrop  is  vigor¬ 
ously  supporting  this  direction  of  handling  qualities  research,  and  hopes 
that  this  account  will  stimulate  similar  work  elsewhere;  there  are  many 
Important  problems  within  reach. 
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COMPARISON  OF  SEVEN  PERFORMANCE  MEASURES 
IN  A  TIME-DELAYED  MANIPULATION  TASK* 

Joi J1*  W.  Hill 

Stanford  Research  Institute 
Menlo  Park,  California  94025 

ABSTRACT 

Real-time  performance  data  was  collected  during  a  pick-up  task  carried 
out  with  Rancho  master-slave  manipulator  using  a  minicomputer-based  data 
taker.  Motions  on  all  seven  master  and  all  seven  slave  joints  as  well 
as  instantaneous  electrical  power  consumed  were  continuously  monitored. 

In  addition  to  the  usual  task-time  measurements,  computer  algorithms  to 
integrate  the  energy  consumed  and  to  count  and  time  the  number  of  moves 
were  implemented.  In  addition  to  these  measures,  several  derived  measures 
as  the  fraction  of  time  moving  (MRATIO)  and  mean  time  per  move  (MBAR) 
were  obtained  in  an  off-line  analysis.  A  major  goal  of  these  experiments 
is  to  compare  the  seven  different  measures  of  performance  to  determine 
which  are  best  for  evaluating  particular  experimental  conditions.  Pre¬ 
liminary  results  of  the  time  delay  experiment  indicate  that  two  new 
measures,  MRATIO  and  MBAR,  are  almost  an  order  of  magnitude  more  sensitive 
than  task  time,  the  conventional  measure,  in  determining  performance 
changes  with  transmission  delays  in  the  range  from  0.0  to  1.0  second. 

Taking  advantage  of  the  operator's  move-and-wait  strategy,  we  also  show 
how  the  energy  consumed  in  carrying  out  a  task  can  be  reduced  by  a  factor 
of  three  in  the  one-second  transmission-delay  case. 


This  work  was  supported  by  the  National  Aeronautics  and  Space  Administra¬ 
tion  under  Contract  NAS2-7507  to  SRI. 
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BACKGROUND 


In  communication  systems  with  transmission  delay,  such  as  those  used 
in  exploration  of  the  moon  or  the  planets,  direct  control  by  human  oper¬ 
ators  becomes  a  very  slow  and  laborious  process.  The  problem  is  that 
the  operator  cannot  see  the  results  of  an  action  until  some  later  time 
determined  by  the  transmission  delay.  During  this  period,  the  environ¬ 
ment  may  have  changed,  or  a  movement  may  have  overshot  the  target.  The 
operator  is  thus  forced  into  a  move-and-wait  situation  in  which  his  moves 
are  cautious  and  are  punctuated  with  periods  of  waiting  to  see  the  results 
of  his  actions.  Physical  fatigue  and  frustration  may  compound  the  problem. 

In  experiments  with  a  two-degree-of-freedom  master-slave  manipulator, 
Sheridan  and  Ferrell  (1963)  and  Ferrell  (1965)  found  that  open-loop  task 
measurements  made  with  no  transmission  delay  could  be  used  to  predict 
performance  times  with  1.0-,  2.1-,  and  3. 2-second  time  delays  using  a  simple 
model.  Experimenting  with  a  six-degree-of-freedom  manipulator,  Blackmer 
et  al.  (1968)  found  only  fair  correspondence  between  task  times  with  no 
transmission  delay  and  those  with  1-,  3-,  and  6-second  delays  using  the 
Fer  -11  (1965)  model.  With  a  six-degree-of-freedom  manipulator.  Black 
(1970)  showed  a  high  correlation  between  tank  time  and  the  number  of  moves 
with  a  3.5-second  delay. 

The  preliminary  study  summarized  in  this  paper*  was  carried  out  to 
explore  manipulation  with  a  wide  range  of  transmission  delays.  Shorter 
delays  than  those  used  in  the  previous  studies  (0.0,  0.3,  and  1.0  seconds) 


* 

A  more  complete  description  of  the  work  reported  here  is  given  in  a 
technical  report  (Hill,  McGovern,  and  Sword,  1974). 
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were  included  to  study  the  transition  from 'continuous  to  the  interrupted 
"move-and-wait"  strategy.  Delays  longer  than  those  used  in  previous 
studies  (10  seconds)  were  included  to  determine  the  magnitude  of  the 
attentive  or  steadying  problems  that  would  develop.  Main  departures  of 
this  work  from  the  previous  experiments  are  (1)  that  no  particular  move¬ 
ment  strategy  was  imposed  on  the  subjects,  and  (2)  that  an  automated, 
rather  than  subjective,  method  of  counting  and  timing  moves  was  used. 

A  COMPLEX  MOVE-AND-WAIT  STRATEGY 


A  time  history  of  master  moves  and  the  subsequent  slave  moves  is 
illustrated  in  Figure  1.  A  move  is  defined  as  the  period  of  time  between 
the  beginning  of  a  master  move  and  the  beginning  of  the  subsequent  master 
move.  Each  master  move  is  considered  to  occur  in  three  phases  (Sheridan 
and  Ferrell,  1963):  move  time,  wait  time,  and  reaction  time,  as  defined 
below. 

•  M  —Duration  of  master  move. 

m 

•  M  —Time  from  end  of  master  move  to  end  of  slave  move. 

w 

•  M  — Time  while  master  reacts  to  the  consequences  of  his 

r 

move  and  decides  upon  a  subsequent  move. 

When  a  simple  move-and-wait  strategy  is  being  used,  the  total  task  time 
can  be  expressed  in  terms  of  these  times,  using  the  following  formula: 


Task  Time 


> 


where  N  is  the  total  number  of  moves  required  to  complete  the  task. 
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POSITION 


A  complete  description  of  the  situation,  however,  requires  the 
specification  of  both  the  system  transmission  delay  and  the  slave  move¬ 
ment,  times  defined  below  that  correspond  to  the  previous  master  move  times 


•  T— Round  trip  transmission  delay 

•  S  —Slave  reaction  time 

r 

•  S  —Duration  of  slave  move 

m 

•  S  —Same  as  M  . 

w  r 


FIGURE  1  TIME  HISTORY  OF  THE  Ith  AND  THE  i  +  1**  MOVES  FOR  A 
MOVE-AND-WAIT  SITUATION 


If  the  master  follows  a  true  move-and-walt  strategy  and  does  not  move 
again  until  the  slave  has  finished  moving  (simple  move-and-wait  strategy), 
the  relationship  shown  in  Figure  1  exists  among  the  above  quantities. 


To  investigate  these  quantities  and  their  relationship,  the  trans¬ 
mission  delay  simulation  of  the  supervisory  control  system  described  by 
Hill  and  Sword  '1973)  was  used.  Preliminary  investigations  with  delays 
between  zero  and  five  seconds  indicated  a  considerable  deviation  from 
Sheridan  and  Ferrell' s  (1963)  result;  the  simple  move-and-wait  strategy 
is  not  always  followed.  The  longer  the  time  delay,  the  more  frequently 
complex  moves  are  made  before  the  result  of  the  main  move  is  evident. 
With  a  five-second  time  delay,  for  example,  two  or  three  moves  are  fre¬ 
quently  given  before  their  results  are  seen,  as  if  the  operator  were 
impatient  to  see  his  results.  In  other  cases,  he  overreaches  his  target 
and  makes  a  second  move  while  the  first  move  is  in  progress.  Examples 
of  both  simple  and  complex  moves  are  indicated  in  the  chart  recording 
of  Figure  2,  obtained  with  the  chart  recorder  monitor  described  by  Hill 
and  Sword  (1973). 


MINI -COMPUTER-BASED  PERFORMANCE  MONITOR 


A  mini -computer-based  performance  monitor  package  was  created  to 
study  (1)  the  complex  move-and-wait  strategy,  and  (2)  the  movement  and 
waiting  times  with  different  transmission  delays.  A  series  of  computer 
programs  are  used  to  measure  and  tabulate  the  movement  and  waiting  times 
with  considerably  greater  accuracy  and  reliability  than  is  possible  for 
a  human  observer  with  a  stop  watch. 

The  performance  monitor  package  consists  of  an  on-line  program  for 
data  logging  and  several  off-line  programs  for  numerical  analysis.  Ikiring 
the  experimental  runs,  a  high-speed  disk  memory  logs  on-line  data.  After 
the  experiment  is  completed  the  data  are  copied  to  magnetic  tape  for 
permanent  storage.  Different  off-line  programs  are  used  to  search  the 
log  and  to  extract  the  desired  performance  indices. 

The  on-line  performance  logger  detects  the  beginning  and  end  of  moves 
by  using  derivatives  of  the  individual  joint  angles.  In  total,  14  deriv¬ 
atives  (seven  master-  and  seven  slave-joint  angles)  are  updated  and 
digitally  filtered  every  l/30th  of  a  second.  If  any  of  the  master  or 
slave  joints  exceeds  a  predetermined  threshold  for  motion  during  a  1/30- 
second  period,  a  note  of  the  fact  is  made  in  separate  master-  and  slave- 
move  detection  queues.  These  queues  (software  shift  registers)  record 
whether  or  not  a  move  was  detected  during  12  successive  1/30-second 
intervals.  From  these  intermediate  data,  decisions  are  made  to  determine 
whether  a  master  or  slave  move  has  begun  or  ended.  The  criteria  for  de¬ 
tecting  the  beginnings  and  ends  of  moves  that  have  proved  successful  are 
defined  below: 
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•  Move  criterion.  A  move  begins  whdn  the  velocity  threshold 
Is  exceeded  during  the  current  1/30-second  interval  and  will 
be  exceeded  on  five  of  the  next  12  Intervals. 

•  Done  criterion.  A  move  is  done  when  the  velocity  threshold 
is  not  exceeded  during  the  current  Interval  and  will  not  be 
exceeded  more  than  once  in  the  next  12  intervals . 

Two  total  task  measurements  are  also  obtained.  The  on-line  program 
counts  the  number  of  1/30-second  intervals  taken  to  complete  a  task  and 
logs  the  total  at  the  end  to  permit  the  calculation  of  task  duration. 
Additionally,  it  accumulates  the  current  delivered  by  the  24-volt  servo 
power  supply  every  l/30th  of  a  second  and  logs  the  total  at  the  end  of 
the  run  to  permit  calculation  of  the  total  energy  consumed. 

One  off-line  program  searches  the  data-log  to  calculate  the  following 
seven  different  measures  for  each  test  run: 


M-MOVES 

Number  of  master  moves 

S-MOVES 

Number  of  slave  moves 

ENERGY 

Total  task  energy  consumed 

TIME 

Total  task  time 

MTIME 

Total  time  during  which  the 

master  was  moving 

MRATIO 

MTIME/TIME,  or  the  fraction 

of  task  time  the 

master  was  moving 

MBAR 

MTIME/M -MOVES,  or  the  mean 

time  per  move. 

A  second  program  can  be  used  to  determine  the  distribution  of  move¬ 
ment  times  from  a  particular  set  of  test  runs.  Any  of  the  master-  or 
slave-movement  times  defined  in  Figure  1  can  be  analyzed.  Details  of  the 
on-line  and  off-line  analysis  procedures  are  given  by  Hill  and  Sword  (1974). 

The  experiment  is  arranged  in  a  3  x  5  x  2  factorial  design,  as  shown 
in  Figure  3.  Each  cell  in  the  design  represents  a  performance  character¬ 
istic  measured  on  two  subjects  in  eleven  repetitions  of  the  task. 
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FIGURE  3  DESIGN  OF  THE  PILOT  TIME  DELAY  EXPERIMENT 

The  experiment  variables  are  (1)  manual  control  mode,  (2)  trans¬ 
mission  delay,  and  (3)  replication,  as  indicated  in  Figure  3.  The  manual 
control  mode  is  varied  by  use  of  either  the  Rancho  master  brace  or  a  bank 
of  six  potentiometers.  Transmission  delays  from  zero  to  ten  seconds  are 
provided  in  both  control  conditions,  and  in  all  replications  by  using 
the  30-Hz  delay  line  simulation  (Hill  and  Sword,  1973).  Direct  viewing 
was  used,  and  audio  cues  were  provided  in  all  experimental  cases. 

Apparatus 


The  Rancho  arm  and  computer-augmented  control  system  described  by 
Hill  and  Sword  (1973)  in  Section  II  of  Reference  1  were  used  for  this 
experiment.  The  control  modes  were  solely  manual,  master-slave  modes. 


No  sensory  feedback  other  than  direct  vision  was  provided  to  the  operator. 
The  task  was  to  pick  up  a  block  randomly  placed  within  the  arm  workspace 
and  deposit  it  in  a  small  container. 

Subjects 

Two  male  subjects,  LM  and  SM,  were  used  for  this  experiment.  Both 
had  had  considerable  experience  in  using  the  manual  control  modes  for  a 
pickup  task.  However,  neither  subject  had  ever  attempted  the  task  with 
a  transmission  delay. 

Procedure 

The  on-line  performance  logger  is  started  by  the  experimenter  when 
the  end  effector  passes  through  a  plane  one  foot  above  the  table  top  on 
the  way  down  to  grasp  the  object.  The  experimenter  detects  the  plane 
crossing  by  observing  a  pointer  attached  to  a  string  running  over  a  pulley 
on  the  ceiling  attached  to  the  end  effector.  The  task  is  complete  when 
the  object  is  grasped  and  deposited  in  the  receptacle  about  one  foot  away, 
and  the  end  effector  moves  up  above  the  plane.  Simultaneously,  the  ex¬ 
perimenter  stops  the  performance  logger  by  typing  a  letter  on  the  control 
teletype.  The  difficulty  of  both  the  pickup  and  drop  tasks  is  about 
3.5  bits. 

In  a  single  replication,  each  subject  performed  10  runs  consisting 
of  11  repetitions  each.  Five  runs,  each  corresponding  to  one  of  the 
transmission  delays,  were  performed,  using  each  of  the  two  control  modes. 

This  sequence  was  repeated  three  times  for  each  subject  (three  replications). 
In  all,  each  subject  made  330  Individual  pickups. 
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FIGURE  4  NUMBER  OF  MASTER  MOVES  IN  TIME 
DELAY  EXPERIMENT 

The  increasing  number  of  moves  suggests  that  in  the  zero-  to  one- 
second  time-delay  region,  the  control  strategy  is  being  continuously 
changed  from  continuous  control  to  the  move-and-wait  strategy.  Between 
the  one-  to  three-second  delay  region,  the  number  of  moves  is  constant, 
suggesting  a  constant  move-and-wait  strategy;  and  at  10-seconds'  delay, 
problems  of  holding  the  brace  stationary  for  such  a  long  time  cause  an 
increasing,  perhaps  unintentional,  number  of  brace  moves.  In  going  from 
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three  to  ten  seconds,  the  number  of  knob-generated  moves  does  not  increase 
as  much  as  the  number  of  brace-generated  moves.  If  the  time  delay  were 
increased  much  beyond  ten  seconds,  the  knobs  would  become  the  preferred 
control  mode.  The  constant  number  of  moves  in  the  one-  to  three-second 
range  agrees  with  the  results  of  Sheridan  and  Ferrell  (1963),  and  Ferrell 
(1965),  who  explored  only  this  range.  Outside  this  range,  however, 
different  explanations  must  hold. 

Two  other  measures,  task  time  and  the  time  spent  moving  the  master, 
are  both  shown  for  comparison  tr  figure  5.  Whereas  the  task  time  increases 
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FIGURE  5  TASK  TIME  AND  MOVING  TIME  IN  THE 
TIME  DELAY  EXPERIMENT 

almost  directly  with  the  time  delay,  the  moving  time  is  nearly  constant 
at  about  20  seconds,  independent  of  time  delay.  The  task  time  with  the 
control  brace  can  be  simply  modeled  as  a  fixed  time  of  20  seconds  plus 
20  additional  seconds  for  every  second  of  transmission  delay: 
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TIME  =  20+20  (transmission  delay)  .  (1) 

b 

The  additional  time  (or  cost)  for  using  the  simpler  control  source  (knobs 
instead  of  brace)  is  roughly  25  seconds,  giving: 

TIME  =  45+20  (transmission  delay)  .  (2) 

K 

An  expanded  plot  of  the  relatively  constant  moving  time  is  given  in 
Figure  6.  It  can  be  seen  that  there  is  a  statistically  significant  cross¬ 
over  of  moving  times  between  0.3-  and  1.0-second-transmission  delay,  and 
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FIGURE  6  TOTAL  MOVING  TIME  IN  THE  TIME 
DELAY  EXPERIMENT 


very  large  Increase  in  brace-moving  time  with  the  10-second  delay.  While 
the  percentage  changes  in  moving  time  are  small  compared  to  the  other 
performance  measures,  the  statistically  significant  crossover  between 
0.3-  and  1.0-second  delay  (with  less  moving  time  for  the  brace  at  small 
delays,  and  less  moving  time  for  knobs  at  large  delays),  may  be  the  result 
of  a  changeover  from  the  continuous  to  the  move-and-wait  strategy  in  this 
range  of  time  delays. 

When  the  moving  time  is  divided  by  the  task  time,  we  have  the  pro¬ 
portion  of  time  moving;  or  by  multiplying  by  100,  the  percentage  of  time 
moving.  This  ratio,  which  turns  out  to  be  an  exceedingly  stable  measure 
of  performance,  is  shown  for  this  experiment  in  Figure  7.  In  addition 
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FIGURE  7  PERCENTAGE  OF  TIME  MOVING  IN  THE 
TIME  DEU  <  EXPERIMENT 

to  the  low  variance  of  this  measurement,  two  surprising  results  are  in¬ 
dicated  in  Figure  7.  Looking  at  the  intercept  at  zero  time  delays,  we 
see  that  only  about  half  of  the  time  is  spent  moving  in  this  condition. 
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Previously  it  has  been  assumed  that  in  the  zero  time-delay  condition 
the  master  brace  was  continuously  moving.  The  low  percentage  of  time 
moving  (57  percent),  together  with  the  fact  that  there  are  about  five 
brace  moves  during  the  task  with  zero  time  delay,  tells  us  that  there  are 
several  waits  and  that  the  waits  are  nearly  as  long  as  the  moves.  There 
are  several  possible  alternative  reasons  for  the  apparent  pauses  (move- 
and-wait  strategy)  measured  at  zero- transmission  delay.  One  reason  may 
be  inadequacy  of  the  on-line  performance  logger.  In  this  case,  the 
velocity  threshold  used  to  determine  whether  the  master  is  moving  may  be 
too  high.  Another  explanation  may  be  that  the  master  was  moved  quickly 
and  the  slowly  responding  slave  was  still  moving.  In  this  second  case, 
the  operator  would  be  waiting  for  the  slave  to  come  to  rest  before  making 
another  move.  A  third  explanation  may  *>r  that  control  with  the  brace  is 
somewhat  more  difficult  than  has  been  thought,  and  that  there  is  a  time 
necessary  a<  major-move  points  during  the  task,  when  the  operator  actually 
hesitates  while  deciding  which  Joints  to  move  next  to  produce  the  de¬ 
sired  action. 

Another  surprising  feature  of  the  moving  ratio  of  Figure  6  is  that 
as  the  transmission  delay  increases,  the  curves  do  not  approach  their 
esympiov.o  as  the  reciprocal  of  the  delay.  The  reciprocal  relation  would 
be  predicted  by  the  simple  move-and-wait  strategy  of  Sheridan  and 
Ferrell  (1963).  The  failure  to  hold  with  this  relation  is  roughly  a 
factor  of  two  in  the  moving  time  ratios  shown  in  Figure  7. 

The  reductions  in  the  moving  ratio  with  short  transmission  delays, 
in  three  replications  of  the  experiment  shown  in  Figure  8,  suggest  that 
the  second  of  the  above-mentioned  three  reasons  explains  the  low  moving 
ratios  observed.  Since  the  movinr  ratio  decreases  with  practice,  and  the 


149 


TRANSMISSION  DELAY  —  wcondi 

SA-2583-17 

FIGURE  8  PERCENTAGE  OF  TIME  MOVING  FOR  THE 

THREE  REPLICATIONS  OF  THE  EXPERIMENT 

task  time  also  decreases  with  practice,  the  first  and  third  explanations 
are  ruled  out.  The  hypothesis  that  the  long  wait  times  are  due  to  the 
operator's  waiting  for  the  slave  to  catch  up  with  the  master  can  be  tested 
by  further  processing  of  the  data  taken. 

The  mean  move-time  results  shown  in  Figure  9  suggest  that  the  time 
required  to  make  a  single  move  with  the  knobs  is  half  that  of  the  control 
brace,  independent  of  time  delay.  As  was  shown  previously  in  Figure  4, 
however,  a  larger  number  of  control  movements  are  made  with  the  knobs 
than  the  brace.  Multiplying  movement  time  by  the  number  of  control  moves 
gives  the  relatively  constant  total  moving  time  of  Figure  6. 

For  both  brace  and  knobs,  the  mean  time  per  move  decreases  ns  the 
transmission  delay  is  increased  to  one  second,  is  constant  with  one-  and 
three-second  delays,  and  finally  begins  to  increase  slightly  with  ten 
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FIGURE  9  MEAN  MOVE  TIME  IN  THE  TIME  DELAY 
EXPERIMENT 

seconds'  delay.  These  changes  are  very  similar  to  those  seen  in  the  number 
of  master  moves  shown  in  Figure  7.  For  both  curves,  the  changes  seen  over 
the  first  second  of  transmission  delay  reflect  the  increasing  use  of  the 
move-and-wait  strategy,  and  the  constancy  for  delays  of  one  second  or 
longer  reflects  a  fairly  consistent  move-and-wait  strategy. 

Energy  Consumed  and  a  Scheme  for  Reducing  It 

The  energy  consumed  by  the  slave  arm  in  carrying  out  the  pickup  task 
.s  shown  in  Figure  10.  The  energy  consumption  with  increasing  time  delay 
is  linear  for  both  knob  and  brace  control,  and  is  very  similar  to  the 
task-time  results  shown  in  Figure  3.  The  crossover  between  brace  and 
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FIGURE  10  ELECTRICAL  ENERGY  CONSUMED  IN  THE 
TIME  DELAY  EXPERIMENT 

knobs  at  the  10.0-second  delay  in  Figure  9  is  not  statistically  signifi¬ 
cant,  and  the  energy  consumed  (in  kilowatt  seconds)  for  brace  and  knob 
control  can  be  modeled  as 

Energy  =2+1.2  (transmission  delay)  .  (4) 

b 

Energy  =  3  +  1.2  (transmission  delay)  .  (5) 

K 

The  price  for  using  the  simpler  control  source  (the  knobs)  is  an  addi¬ 
tional  kilowatt  second. 

Combining  the  relationship  of  the  task  time  to  transmission  delay 


[Eqs.  (1)  and  (2)]  with  the  very  similar  relationship  of  energy  to  trans 
mission  delay  [Eqs.  (4)  and  (5)],  we  may  express  task  energy  in  terms  of 
task  time  for  brace  and  knob  control  as 


(6) 


Energy  =  0.8  +  0,06  (task  time) 
b 

Energy  =  0.3  +  0.06  (task  time)  .  (7) 

K 

With  the  simple  master-slave  cont.-ol  scheme  used  in  the  laboratory,  more 
energy  is  consumed  in  carrying  out  the  same  task  as  the  transmission  de¬ 
lay  becomes  greater.  By  using  our  knowledge  that  the  total  moving  time 
for  the  task  is  relatively  constant,  even  though  the  task  time  increases 
greatly  with  transmission  delay  (the  difference  between  the  task  and 
moving  time  of  Figure  3),  we  may  design  a  remote  control  system  that  only 
requires  a  fixed  amount  of  energy  for  a  task,  no  matter  what  the  delay. 
This  can  be  accomplished  by  simply  cutting  off  the  power  at  the  slave  arm 
whenever  it  is  at  rest.  Such  a  modification,  taking  advantage  of  the 
move-and-wait  strategy  to  conserve  power,  could  be  implemented  with  in¬ 
dividual  threshold  circuits  on  each  joint,  each  circuit  capable  of  turning 
off  the  servoamplif ier  whenever  the  error  was  less  than  a  preset  level. 

DISTRIBUTION  OF  MOVEMENT  TIMES 

Using  the  off-line  histogram  program,  we  measured  and  tabulated 
the  durations  of  the  moving  times.  Ten  distributions  were  obtain* d,  one 
for  each  of  the  five  time  delays  and  each  of  the  two  control  modes,  by 
combining  the  data  of  the  two  subjects  and  the  three  replications  of  the 
experiment.  These  results  are  shown  in  Figures  11  and  12.  The  total 
number  of  moves  under  each  curve  and  the  mean  moving  time  for  each  curve 
is  given  in  Table  1. 
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FIGURE  11  DISTRIBUTION  OF  MOVING  TIMES  WITH  BRACE  CONTROL 


DELAY 


FIGURE  12  DISTRIBUTION  OF  MOVING  TIMES  WITH  KNOB  CONTROL 


Table  1 


TOTAL  NUMBER  OF  &10VES  AND  MEAN  MOVING  TIME 
FOR  THE  PILOT  TIME  DELAY  EXPERIMENT 


Control 

E5B1 

Moves 

Mean  Move  Time 

0.0 

427 

1.938 

0.33 

643 

1.542 

Brace 

1.0 

1044 

1.135 

3.0 

1056 

1.059 

10.0 

1581 

1, 224 

0.0 

1033 

...  188 

0.33 

1448 

C.861 

Knobs 

1.0 

1570 

0.505 

3.0 

1607 

0.532 

10.0 

1567 

0.630 

Several  changes  are  obvious  from  the  curves  and  data  of  Table  1. 

As  the  transmission  delay  increases,  so  does  the  number  of  moves  of 
duration  shorter  than  0.5  second,  with  both  knob  and  brace  control.  On 
the  other  hand,  the  number  of  moves  longer  than  2.0  seconds  decreases 
with  knob  control,  but  increases  with  brace  control,  as  the  transmission 
delay  increases.  These  differences  may  be  due  to  the  great  increase  in 
total  moves  (270  percent)  with  brace,  and  small  increase  with  knobs 
(52  percent),  as  the  transmission  delay  goes  from  0.0  to  10.0  seconds. 

A  surprising  feature  of  the  brace-mc  v  i.ng  time  distributions  is  the 
constancy  of  the  shape  of  the  distribution  with  increasing  time  delay. 

It  has  been  assumed  previously  that  going  from  continuous  to  delayed 
conditions  caused  the  operator  to  change  from  continuous  moving  to  abrupt, 
short  moves  and  ensuing  waits.  The  results  of  Figure  11,  however,  show 
that  the  moving  times  are  very  similar  for  continuous  and  time-delayed 
operation.  There  is  a  large  proportion  of  long  moves  (two  seconds  or 
more)  for  all  time  delays. 
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The  distribution  of  knob  moves  better  fits  the  stereotyped  change 
from  continuous  to  move-and-wait  strategy.  These  distributions  (see 
Figure  12)  can  be  visually  broken  down  into  the  sum  of  two  distributions, 
one  peaking  between  0.4  and  0.5  seconds,  and  a  second  continuous,  long¬ 
tailed  distribution  similar  to  that  of  the  brace  distribution  of  Figure  11. 
As  the  time  delay  increases,  the  area  under  the  peaked  distribution  greatly 
increases,  while  the  amplitude  of  the  long-tailed  distribution  greatly 
decreases. 
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COMPARISON  OF  SEVEN  DIFFERENT  PERFORMANCE  MEASURES 


An  analysis  of  variance  was  made  on  each  of  the  performance  measures 
to  determine  their  ability  to  distinguish  between  the  four  experimental 
variables:  test  subjects,  replications,  means  of  control,  and  time  de¬ 
lays.  The  results  of  these  analyses,  summarized  in  Table  2,  show  that 
a  large  number  of  the  variables  and  their  interactions  are  statistically 
significant. 

In  addition  to  being  a  test  of  the  null  hypothesis  for  each  variable, 
the  F-ratios  given  in  Table  2  are  figures  of  merit  for  determining  which 
of  the  seven  measures  best  indicates  changes  from  a  particular  variable 
or  combination  of  variables.  For  a  good  performance  measure,  we  want 
(1)  large  changes  (large  variance)  in  the  measure  with  an  experimental 
variable;  and  (2)  small  changes  (small  variance)  in  repeated  measurements 
with  the  same  conditions.  The  F-ratio  is  the  ratio  of  the  variance 
attributed  to  an  experimental  variable  divided  by  the  variance  in  re¬ 
peated  measurements.  Thus,  the  larger  the  F-ratio,  the  better  a  measure 
distinguishes  between  experimental  variables. 

With  the  F-ratio  used  as  a  figure  of  merit,  the  largest  F-ratio  for 
each  of  the  15  sources  of  variation  given  in  Table  2  is  marked  with  a 
rectangular  box.  Surveying  the  seven  performance  measures  indicates  that 
only  five  rank  largest  in  some  source  of  variation;  and  of  these,  only 
three  claim  the  great  majority  of  the  largest  F-ratios.  The  three  most 
important  measures,  in  decreasing  rank,  are 

•  Moving  ratio 

•  Total  moving  time 


•  Task  time. 
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These  results  indicate  that  different  measurements  should  be  made, 
depending  on  which  experimental  conditions  it  is  desirable  to  compare. 

For  example,  differences  between  subjects  are  best  measured  with  task 
time  (TIME) ;  and  differences  between  control  source  are  best  measured 
with  moving  time  (MTIME),  or  mean  movement  time  (MBAR). 

Another  way  of  ranking  the  experimental  variables  is  by  the  total 
variance  attributed  to  each.  This  ratio  lumps  the  test  conditions  and 
their  interactions  into  one  figure  of  merit  and  indicates  for  the  experi¬ 
ment  as  a  whole  which  measurement  is  best.  The  resulting  variance  ratios 
given  in  Table  3,  indicate  that  the  MRATIO  is  clearly  the  best  measure¬ 
ment,  and  that  MBAR  and  TIME  are  the  second  best.  For  the  experiment  as 
a  whole,  MRATIO,  the  fraction  of  time  moving,  is  by  far  the  most  sensi¬ 
tive  measurement. 


Table  3 

TOTAL  EXPERIMENTAL  VARIANCE 
DIVIDED  BY  ERROR  VARIANCE 


Variable 

Variance  Ratio 

M- MOVES 

12.06 

S-MOVES 

8.31 

ENERGY 

14.97 

TIME 

23.00 

MTIME 

8.03 

MRATIO 

81.09 

MBAR 

28.63 

CORRELATIONS  BETWEEN  THE  SEVEN  PERFORMANCE  MEASURES 


Frequently  two  or  more  measures  change  nearly  identica’lj  with  the 
experimental  variables.  For  example,  the  task  time  and  the  energy  con¬ 
sumed  both  vary  similarly  for  the  different  time  delays  and  control 

sources.  To  determine  the  relation  between  the  seven  performance  measures 

* 

the  pairwise  correlation  coefficients  based  on  all  660  measured  values 
of  each  variable  were  computed.  The  results  are  shown  in  Table  4  as  an 
array  of  correlation  coefficients.  Some  interesting  relations  between 
variables  shown  in  the  correlation  coefficients  are  mentioned  below. 

•  The  number  of  master  and  slave  moves  (M-MOVES  and  S-MOVES) 
are,  as  we  might  expect,  highly  correlated  (r  =  0.961); 
and  we  may  consider  that  either  of  these  two  variables 
measures  changes  in  the  other.  We  recommend  selecting 
the  number  of  master  moves  as  a  performance  measure  and 
not  being  concerned  with  the  number  of  slave  moves. 

•  Task  time  and  energy  consumed  are  also  highly  correlated 
(r  =  0.913),  and  we  may  similarly  choose  either  of  these 
variables  as  representative  of  the  changes  measured  by 
the  other.  As  time  has  been  measured  in  these  experi¬ 
ments  as  a  matter  of  course,  and  is  easy  to  measure 
without  sophisticated  equipment,  we  think  time  is  a 
better  measure  of  performance  than  energy.  It  is  possible 
to  express  energy  in  terms  of  time,  using  the  equations 
given  previously  in  the  discussion  of  energy. 

•  The  last  three  variables,  MTIME,  MRATIO,  and  MBAR,  corre¬ 
late  poorly  with  each  other  and  with  the  other  variables 
in  the  experiment. 


* 

Pearson  correlations,  r 


0  /o  0  . 

xy  x  y 
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The  total  moving  time,  MTIME,  does  not  correlate  statis¬ 
tically  with  MRATIO  or  MBAR  (p  >  0.01),  which  indicates 
that  the  total  moving  time  maasures  a  performance  charac¬ 
teristic  that  is  independent  of  these  other  two  variables. 

This  analysis  shows  that  the  number  of  performance  measures  can  be 
reduced  because  of  high  correlations  between  some  of  the  measures.  Both 
the  number  of  slave  moves  and  the  energy  consumed  may  be  omitted  because 
of  their  high  similarity  to  other  measures.  Taking  the  two  measures 

Table  4 

CORRELATION  COEFFICIENTS  BETWEEN  VARIABLES  IN  THE  PRELIMINARY 

TIME  DELAY  EXPERIMENT 


Coefficients  not  significant  at  the  0,01  level 
are  designated  by  0. 


M-MOVES  and  TIME  together  with  any  one  of  the  remaining  three  (MTIME, 
MRATIO,  and  MBAR),  we  may  reproduce  any  of  the  others.  This  is  true  be¬ 
cause  of  the  relations  between  the  variables  as  they  are  defined  on  the 
first  page  of  this  section.  Because  of  its  low  variation,  the  choice  of 
MRATIO  (MTIME  divided  by  TIME)  as  the  third  variable  to  complement  M-MOVES 
and  TIME  seems  a  natural  choice.  As  a  consequence,  three  measurements, 
M-MOVES,  TIME,  and  MRATIO  are  recommended  as  a  complete  description  of 
time-delayed  performance. 


CHOICE  OF  MEASURES  FOR  FUTURE  EXPERIMENTS 
WITH  A  TRANSMISSION  DELAY 


Though  the  range  of  delays  used  in  this  experiment  varied  from  0.0 
to  10.0  seconds,  the  main  purpose  in  analyzirg  it  was  to  determine  the 
ranges  and  usefulness  of  several  performance  measures  in  the  transmission 
delay  range  from  0.0  to  i.O  second.  These  results  will  be  used  to  design 
the  main  transmission-delay  experiment,  which  will  have  a  finer  gradation 
of  delay  within  this  range. 

To  compare  the  seven  different  performance  measures  in  the  delay 
range  from  0.0  to  1.0  second,  certain  measurements  obtained  with  the 
control  brace  for  two  subjects  are  given  in  Table  5.  The  table  presents 
in  successive  columns  measurements  taken  with  no  delay  and  with  1.0 
second  delay;  the  percentage  change  of  the  measurements  in  going  from 
0.0  to  1.0  second  delay;  and  the  change  measured  in  standard  deviations 
in  going  from  0.0  to  !.0  second  delay.  A  desirable  feature  of  a  per¬ 
formance  measure  is  a  large  percentage  change  in  going  from  one  case  to 
another.  A  more  valuable  feature,  however,  particularly  for  statistical 
comparison  and  hypothesis  testing,  is  the  change  measured  in  standard 
deviations. 

On  the  basis  of  the  previous  correlation  analysis  and  the  change 
in  standard  deviations  from  Table  5,  the  following  conclusions  may  be 
made  regarding  measurements  to  be  taken  on  the  main  transmission-delay 
experiment. 


•  M-MOVES  is  a  better  measure  than  S-MOVES  (both  are  highly 
correlated),  because  of  the  greater  change  in  standard 
deviations. 

•  TIME  is  a  better  measure  than  ENERGY  (both  are  highly 
correlated),  for  the  above  reason. 

•  Neither  TIME  nor  ENERGY  is  a  really  good  statistical  measure 
of  performance,  because  of  their  low  change  in  standard  de¬ 
viations  over  this  delay  range.  TIME  should  be  included  in 
the  analysis  for  comparison  with  results  of  past  experiments. 

•  Of  the  last  three  new  measures,  MRATIO  and  MBAR  are  most  re¬ 
liable  of  all,  showing  larger  changes  (measured  in  standard 
deviations)  than  any  of  the  other  variables. 

•  MBAR,  the  mean  move  time,  is  by  far  the  best  measure,  showing 
an  overall  change  of  more  than  two  to  one  (the  highest,  except 
for  M-MOVES),  and  by  far  the  most  reliable,  with  a  change  of 
26  standard  deviations. 


Table  5 

COMPARISON  OF  SEVEN  DIFFERENT  MEASURES  OF  PERFORMANCE 
WITH  THE  OONTROL  BRACE  AT  ZERO  AND  ONE  SECOND  DELAY 


Variable 

AT  =  0 

m 

Percentage 

Change 

Change  in 

Standard  Deviations 

M-MOVES 

6.47 

16.22 

150 

10.4 

S-MOVES 

5.47 

13.53 

147 

8.9 

ENERGY  (kW-s) 

1.56 

3.05 

95 

2.8 

TIME  (s) 

22.56 

46.76 

107 

3.4 

MTIME  (s) 

12.49 

18.22 

45 

6.4 

MRATIO 

0.56 

0.39 

-31 

-22,1 

MBAR  (s) 

2.40 

1.14 

-52 

-26,3 
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HUMAN  OPERATOR  WORKLOAD 
FOR  VARIOUS  CONTROL  SITUATIONS 
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ABSTRACT 

This  paper  presents  the  results  of  an  exploratory  experiment  which  was 
conducted  to  investigate  human  response  characteristics  in  control  situations  of 
widely  varying  difficulty.  The  experiment  was  aimed  at  a  better  understanding 
of  the  human  operator  limitations  in  terms  of  control  effort  as  included  in  the 
optimal  control  model  which  is  briefly  discussed  in  the  next  section. 

Based  on  the  experimental  results  a  workload  index  is  presented  which  is 
consistent  with  those  suggested  by  others  in  the  past  and  an  extended  version  of 
the  workload  index  given  by  Levison  et  al  (Ref.  3). 

As  will  be  shown  the  "predicted"  workload  correlates  excellently  with 
subjective  ratings  and  seems  to  have  a  useful  generality. 
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1  INTRODUCTION 

The  ever  increasing  complexity  of  man-machine  systems  necessitates  a  better 
understanding  of  the  relevant  human  functions  in  order  to  base  design  problems  on 
more  rational  principles.  The  study  which  is  the  subject  of  this  paper  concentrates 
on  the  human  controller's  function.  This  function  is  often  important  and  even 
crucial  in  many  man-machine  situations. 

Apart  from  human  performance,  which  is  for  a  given  control  situation  directly 
related  to  system  performance,  it  is  also  necessary  to  consider  the  effort  the 
human  has  to  exert  to  achieve  that  performance.  Even  this  restricted  concept  of 
control  effort  has  so  far  hardly  obtained  the  attention  which  it  deserves  in  many 
manual  control  problems . 

In  this  paper  an  experimental  program  is  reported  which  was  conducted  to 
explore  human  response  characteristics  in  various  control  task  situations.  Experi¬ 
mental  results  were  obtained  in  terms  of  subjective  ratings  and  model  parameters 
of  the  (fitted)  optimal  control  model  which  is  briefly  discussed  in  the  next 
section.  In  terms  of  these  parameters  a  workload  model  is  defined.  The  computed 
model  "predictions"  are  compared  with  the  subjective  ratings.  Also  trade-offs 
between  performance  and  effort  are  considered. 

2  OPTIMAL  CONTROL  MODEL  AND  TASK  INTERFERENCE  MODEL 

This  section  contains  the  principal  features  '  the  optimal  control  model  of 
the  human  as  a  feedback  controller  developed  by  Kleinman  et  al  (Ref.  l).  Although 
the  model  is  discussed  extensively  e^sewere,  it  will  be  described  briefly  in  this 
section  for  completeness  sake. 

The  model  is  based  on  optimization  and  estimation  theory  and  can  be  used  for 
multivariable  linear  control  systems.  The  basic  assumption  is  that  the  well-trained, 
well-motivated  human  operator  behaves  "optimally"  in  some  sense,  subject  to  his 
inherent  limitations  and  constraints  and  his  control  task. 

2.1  System  and  task  description 

It  is  assumed  that  the  system  dynamics  can  be  represented  by  the  linear(ized) , 
time-invariant  equations  of  motion 

x=Ax+Bu+Ew  (1) 

where  x  is  the  vector  of  system  states 

u  the  vector  of  pilot  control  outputs 

w  the  vector  of  linear  independent  Gaussian  white  noises. 


The  system  outputs  consist  of  the  displayed  variables  and  are  assumed  to  be 
linear  combinations  of  the  state  and  control  variables 

£“Cx+Du  (2) 

Primarily  the  perception  of  these  variables  (y^)  is  subject  to  the  human's 
psychophysiological  limitations. 


The  control  task  is  specified  in  terms  of  a  performance  criterion  that  the 
human  is  to  optimize.  This  criterion  is  incorporated  in  a  cost  functional, 
conditioned  on  the  observations  y^,  which  is  minimal  for  the  optimal  control  input 

J  (u)  »  E  [  y  +  u'R  u  +  u'G  u  ^  (3) 

For  relatively  simple  control  tasks  (single  axis),  good  approximations  to 
experimental  measurements  have  been  obtained  (also  in  the  present  program)  with 
a  cost  functional  consisting  simply  of  a  weighted  sum  of  system  error  variance  and 
control  rate  variance.  This  cost  on  control  rate  results  in  a  first  order  lag 
(time  constant  T^)  being  introduced  in  the  optimal  controller. 

2.2  Human  limitations 

The  psychophysical  limitations  inherent  in  the  human  which  are  included  in 
the  model  are  represented  by 


Zp  (t)  =  y;  (t-T)  +  ^  (t-T^) 


(*+) 


indicating  that  the  human  perceives  a  noisy,  delayed  version  of  the  displayed 
variables,  v  is  a  vector  of  white  Gaussian  observation  noises,  the  autocovariance 

y 

of  each  observation  noise  component  appears  to  vary  proportionally  with  mean 
squared  signal  level 


(5) 


where  P  is  the  noise/signal  ratio  and  has  units  of  normalized  power 

yi 

(positive  frequencies)  per  rad/sec. 


In  order  to  model  certain  control  situations  adequately,  it  is  necessary  to 

include  a  motor  noise  term  v  in  addition  to  the  observation  noise. 

— u 
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Also  the  motor  noise  vector  is  assumed  to  consist  of  independent,  zero-mean, 
Oaussian  white  noises.  The  element  of  the  autocovariance  V  is  assumed  to  be 


2.3  Model  structure 

The  model  consists  of  a  cascade  combination  of  a  Kalman  filter,  a  least-mean- 
squared  predictor  and  a  set  of  gains,  acting  on  the  best  estimate  of  the  system 
states . 

2.4  A  model  for  task  interference  and  workload 

Levison  et  al  (Ref.  3)  define  a  workload  index  as  the  fraction  of  the 
controller's  capacity  that  is  required  to  perform  a  given  task  to  some  specified 
level  of  performance .  The  concept  of  this  index  is  based  on  the  assumption  that 
the  human  operator  possesses  a  fixed  amount  of  (channel)  capacity  to  be  shared 
among  his  tasks  It  is  straightforwardly  derived  from  their  model  for  task 
interference.  This  model  is  based  on  the  assumptions  that 
.  multiple  tasks  are  performed  in  parallel 

.  the  human  operator  has  a  fixed  amount  of  "information-processing"  capacity 
("channels")  to  distribute  among  his  various  tasks 
.  each  information-processing  channel  is  perturbed  by  a  white,  Gaussian 
noise  process  which  is  linearly  uncorrelated  with  all  other  noise  processes 
and  system  variables.  The  noise  levels  are  proportional  to  signal  variance. 


The  model  implies  that  the  power  spectral  density  level  of  the  equivalent 
observation  noise  process  (all  sources  of  randomness  of  the  human  operator  are 
reflected  to  his  input)  is  inversely  proportional  to  the  fraction  of  capacity 
that  is  required  to  perform  a  given  control  task  (m) 


P 

m 


(7) 


where  the  observation  noise  ratio  PQ  corresponds  to  "full  capacity". 
The  workload  index  is  defined  as 
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WI 


(8) 


P 

o 
P 

c 

where  P^  is  the  noise  ratio  corresp jnding  to  the  required  level  of  system 

performance . 

The  generality  of  the  aforementioned  model  is  limited  because  the  workload 
index  is  highly  task-dependent  and  "calibration"  experiments  will  be  necessary  to 
determine  the  human  operator's  "full"  capacity  in  a  given  control  situation.  Next 
the  fraction  of  this  "total"  capacity  can  be  determined  in  multiple-tasks 
situations.  As  such,  the  workload  index  serves  only  as  a  means  for  comparing  the 
relative  load  imposed  on  the  human  operator  by  various  tasks. 

In  order  to  derive  an  absolute  workload  metric  which  can  be  used  to  predict 
the  load  imposed  on  the  human  operator  in  new  control  situations,  it  is  necessary 
to  determine 

.  how  the  total  capacity  is  related  to  the  human  operator's  environment, 
specifically,  the  task  variables. 

.  the  relationship  between  the  actual  effort  the  human  operator  exerts  and 
the  demand  of  the  task. 

The  primary  goal  of  the  experimental  program  discussed  in  the  next  section, 
was  to  provide  data  for  a  variety  of  control  situations  to  build  and  validate  an 
absolute  workload  model. 


3  EXPERIMENTS 

3.1  Experimental  conditions 

In  order  to  include  all  possibly  important  characteristics  of  pilot  behaviour 
in  control  situations  of  (our)  interest,  a  variety  of  single-axis  control  tasks 
were  performed  by  four  well-trained,  highly  motivated  subjects  (experienced 
fighter  pilots).  The  controlled  elements  are  summarized  in  table  1.  As  shown  in 
the  table,  the  choice  of  the  tasks  were  mainly  determined  by  two  characteristics: 
pilot  equalization  and  the  sensitivity  of  task  performance  to  the  effort  exerted 
by  the  human  operator.  The  latter  was  considered  to  be  an  important  aspect  of  the 
given  problem  and  a  means  to  achieve  sufficient  variation  in  task  difficulty  to 
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obtain  statistically  significant  differences  in  the  experimental  data:  scores 
of  system  parameters  of  interest,  frequency  domain  measures  (describing  function 
and  remnant  data) ,  and  subjective  information  by  means  of  the  rating  scales  given 
in  table  2.  Three  scales  were  presented  to  the  subjects,  a  non-adjectival  rating 
scale  and  two  scales  (controllability  and  demand  on  the  pilot)  adapted  from 
reference  U. 

The  task  was  to  regulate  against  a  disturbance  input.  The  inputs  were  summed 

sinusoids  to  provide  signals  that  were  random  appearing  and  whose  spectra 

approximated  white  noise  filtered  by  a  second  order  filter  with  a  pole  at  2  rad/ 

2 

sec  and  a  mean-squared  value  of  1 .2  cm  on  the  display  for  the  position  control 

task.  For  the  rate-  and  acceleration  control  tasks  the  disturbance  spectra 

approximated  white  noise  processed  by  a  first  order  filter  with  a  pole  at  1  rad/ 

sec  entering  the  system  as  a  velocity  disturbance  with  a  mean-squared  value  of 
2  2 

1  cm  /sec  .  The  system  output  was  displayed  on  a  CRT.  The  display  format  was  a 
cross.  The  distance  of  the  eye  to  the  CRT  was  such  that  1  cm  on  the  display 
corresponded  to  1  deg  visual  arc.  The  subjects  manupulsted  a  force-sensitive  hand 
control. 

3.2  Experimental  results. 

The  experimental  results  are  presented  in  terms  of  scores  and  frequency 
domain  measurements  (describing  function  and  equivalent  observation  noise).  The 
inter-  and  intra-subject  variability  was  sufficiently  small  to  obtain  meaningful 
measures  that  were  representative  of  subject  behaviour  in  general  by  averaging 
the  measures  of  the  subjects  and  the  replications  (four  subjects,  three  runs/ 
subject) . 

Both  the  measured  scores  and  the  frequency  domain  measurements  were  matched 
with  the  model  results  by  adjusting  the  following  model  parameters: 
the  relative  weighting  on  control  rate  variance  (uniquely  related  to  the  lag 
factor  Tjj),  the  time  delay,  the  observation  noise  ratios,  associated  with  both 
position  and  rate  of  the  display  indicator,  and  (if  necessary)  the  motor  noise 
ratio.  The  model  parameters  obtained  are  given  in  table  3. 

Table  3  reveals  that  the  time  delay  T'is  essentially  constant  for  all  the  tasks. 
Also  the  lag  factor  T^  exhibits  a  relatively  small  variation.  As  distinct  from 
results  reported  in  reference  5  different  observation  noise  ratios  to  be  associ- 
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ated  with  position  and  rate  informations  were  necessary  to  obtain  a  good  match  to 
the  measured  remnant  spectra.  For  the  acceleration  control  tasks  the  values  of  the 
position  noise  ratios  are  somewhat  arbitrary  because  both  scores  and  frequency 
domain  measurements  are  hardly  changed  by  an  increase  of  this  noise  ratio  of 
-10  dB  to  -20  dB.  For  the  acceleration  tasks  a  substantial  motor  noise  level  had 
to  be  included. 

The  scores  obtained  from  the  experiments  and  from  the  model  are  shown  in 
table  U.  As  can  be  seen  from  this  tsble  the  model  scores  agree  very  well  with  the 
measured  scores.  !Hie  frequency  domain  measures  in  terms  of  describing  functions 
and  normalized  observation  noise  spectra  are  given  in  figures  1-6.  As  can  be  seen 
from  these  figures  the  agreement  between  experimental  frequency  domain  measures, 
and  the  measures  obtained  from  the  model  is  good. 

The  subjective  ratings  were  normalized  so  that  the  ratings  of  every  subject 
had  a  mean  of  zero  and  a  standard  deviation  of  unity  (z-scores).  Next,  the 
ratings  of  the  subjects  were  averaged.  The  correlation  between  the  ratings  of 
the  effort  scale  and  the  data  of  the  demand  scale  was  very  high  (linear  correlation 
coefficient  of  .99)*  Hence,  only  the  ratings  of  the  (non  adjectival)  effort  scale 
(table  5)  are  considered  in  the  following  discussion. 

Hie  aforementioned  results  have  shown  that 

.  for  a  variety  of  control  situations  the  available  measures  of  human 
operator  behaviour  can  accurately  be  duplicated  by  the  optimal  control 
model  by  primarily  a  variation  in  the  pertinent  noise  ratios 

.  The  values  of  the  noise  ratios  are  task  dependent 

.  The  effort  involved  in  achieving  the  pertinent  noise  ratios  is  clearly 
task  dependent . 

The  last  observation  can  be  demonstrated  comparing  the  K  with  the  K/b 
configuration.  The  control  effort  according  to  the  subjective  ratings  was  for 
both  tasks  the  same,  yet  the  observation  noise  levels  are  substantially  lower  for 
the  position  control  task.  Evidently,  it  was  easier  for  the  subjects  to  realize 
these  low  noise  ratios  for  the  position  control  task  than  in  the  rate  control 
situation. 
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1*  HUMAN  OPERATOR  WORKLOAD  MODEL 


Baaed  on  the  foregoing  observations  a  control  effort  index  is  proposed  in 
accordance  with  work  done  by  other  researchers  and  consistent  with  some  notions  of 
attention  and  effort  of  the  experimental  psychology  (Refs.  6  and  7). 

The  index  is  based  on  the  following  notions: 

.  Human  operators  behaviour  is  partly  determined  by  mechanisms  that  control  the 
choice  of  stimuli,  by  which  is  meant  both  selectively  attending  to  some  stimu¬ 
li  in  preference  to  others  and  investing  more  or  less  attention  per  source  of 
information.  This  can  be  identified  with  voluntary  attention,  reflecting  that 
the  subject  attends  to  the  stimuli  because  of  their  relevance  for  performing 
the  task  and  not  only  because  of  their  arousal  function. 

.  Also  the  aspect  of  involuntary  attention  has  to  be  included  in  the  index. 

This  can  be  related  to  the  level  of  arousal  and  is  largely  dictated  by  the 
properties  of  the  stimuli.  Processing  novel  and  surprising  stimuli  involves 
more  effort  than  in  the  situation  of  more  familiar  stimuli. 


The  formes  aspect  (voluntary  attention)  is  incorporated  in  the  control  effort 
index  in  terms  of  signal  to  noise  ratio  of  the  various  sources  of  information.  This 
can  be  identified  with  the  amount  of  attention  as  suggested  by  Levison  et  al. 

The  latter  aspect  (involuntary  attention)  is  included  in  terms  of  sensitivity  of 
task  performance  (mean  squared  error  or  error  rate)  to  the  momentary  attention  paid 
by  the  subject  as  indicated  by  the  pertinent  signed  to  noise  ratios. 

Thus,  the  workload  index  can  be  represented  as 

W  -  |  (9) 

with  P 

2 

cr 

S  *  — —  ( 10a) 
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where  CT^  is  now  taken  as  the  relevant 

performance  index  (variance)  of  quantity  x 


An  alternate  expression  for  S  is 

_lxrx2(<iB) 

S  =  DP  (dB) 


(10b) 


In  control  situations  where  more  than  one  source  of  information  is  of  interest 
(position  information,  rate  information,  etc.)  the  workload  index  is  defined  as 
the  sum  of  the  separate  portions. 


For  the  six  control  situations  previously  discussed  the  sensitivity  parameter 
S  was  straightforwardly  computed  for  the  model  parameters  of  table  3*  The  result  is 
shown  in  table  6.  Before  going  into  a  discussion  of  this  table  the  relationship 
between  the  "predicted"  workload  and  the  subjective  ratings  is  shown  in  figure  7- 
The  relationship  is  surprisingly  linear  (r  ■  . 99 *• )  • 

Returning  to  table  6  it  can  be  seen  that  the  effort  involved  in  controlling 
the  K-dynamics  is  primarily  related  to  position  information  (which  is  well  known). 
Most  of  the  load  imposed  on  controlling  the  K/s  dynamics  is  related  to  rate  infor¬ 
mation.  Practically  all  the  effort  involved  in  the  acceleration  control  tasks  is 
connected  to  processing  rate  information  (which  was  expected) .  The  position  of  work' 
load  related  to  attending  to  position  information  is  negligibly  small.  For  the 
acceleration  control  situations  where  motor  noise  had  to  be  included  the  partial 
.  .  . 

derivative ,  implied  a  constant  motor  noise  ratio.  The  effect  of  motor  noise 
0 

m 

on  the  workload  index  is  implicit.  The  same  is  true  for  the  other  model  parameters 
(time  delay  and  lag  factor). 

It  is  interesting  to  consider  the  relationship  between  system  performance  and 
workload.  For  the  position  control  task  this  is  shown  in  figure  8. 

Both  position  noise  ratio  and  rate  noise  ratio  are  independently  varied.  The  arrows 
indicate  the  levels  of  load  imposed  on  processing  position,  respectively  rate  in¬ 
formation.  Figure  9  shows  the  same  trade-off  for  the  rate  control  task.  As  might  be 
expected,  exerting  little  effort  gives  a  relatively  large  improvement  in  performanc 
Below  a  certain  level  of  performance  the  effect  of  more  effort  is  very  small.  One 
would  expect  the  optimum  trade-off  at  the  "knee"  of  the  curve.  The  experimental 
result  confirms  this.  The  same  discussion  is  applicable  to  the  acceleration  control 
task.  For  this  situation  the  pertinent  relationship  is  visualized  in  Figure  10. 

Important  the  predictive  power  of  the  model,  in  the  case  of  new  control 
situations. 

The  following  procedure  is  suggested. 

1.  take  a  time  delay  of  .20  sec  and  adjust  the  relative  weighting  on  control 
rate  to  yield  a  lag  time  constant  of  approximately  .1  sec. 

2.  Neglect  motor  noise  or  predict  motor  noise  on  the  basis  of  the  relationship 
between  scores  and  motor  noise  ratio. 

3.  Starting  with  nominal  values  of  observation  noise  ratios  compute  the  trade¬ 
off  between  system  performance  and  workload. 

In  case  the  system  performance  is  specified  the  workload  is  determined. 

Otherwise  both  system  performance  and  workload  can  be  established  as 
suggested  in  Figs.  8-10. 


5  CONCLUDING  REMARKS 


AIbo  the  present  experiments  have  demonstrated  that  the  optimal  control  model 
provides  a  useful  tool  to  describe  human  operator  behaviour  in  a  variety  of 
control  situations. 

The  workload  index  suggested  in  this  paper  correlates  surprisingly  well  with 
subjective  ratings.  By  means  of  trade-off  studies  between  system  pe  formance  and 
pilot  workload,  the  effect  of  task  variables  of  interest  in  new  control  situation 
can  be  studied. 

More  control  situations  (also  multiple  control  tasks)  have  to  be  considered 
to  be  able  to  extend  the  generality  of  the  proposed  workload  index. 
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increasing  effort 


Rating  scale  for 
Control* lability  and  Precision 


Rating  Scale  for 
Demands  on  Pilot 


Extremely  easy  to  v  ;rol 
with  excellent  pre„.‘  ion 


Very  easy  to  control  with 
good  precision 


— >  Completely  undemanding, 
very  relaxed  and  comfortable 

—  Largely  undemanding  relaxed 


Fasy  to  control  with  fair 
precision 


'  Controllable  with  somewhat 
[inadequate  precision 

(Controllable,  but  only  rery 
^ imprecisely 

Difficult  to  control 


Very  difficult  to  control 
’  Nearly  uncontrollable 


Ut  controllable 


Not  applicable 


— < Mildly  demanding  of  pilot 
l attention,  skill,  or  effort 

[Demanding  of  pilot  attention, 
— \  skill,  effort 

(Very  demanding  of  pilot  a 
tention,  skill,  or  effor 

(Completely  demanding  of  p 
“  1  attention,  skill,  or  off 


Very  demanding  of  pilot  at¬ 
tention,  skill,  or  effort 


{Completely  demanding  of  pilot 
attention,  skill,  or  effort 

Nearly  uncontrollable 


^  O  Uncontrollable 
(~"1  Not  applicable 


Controlled  Time  Lag  Observation  Motor  noi  e 

element  Delay  Factor  noise  ratio  (dB)  ratio 


K  .20  .07  -23.6  -26.0 

K/g  .21  .13  -15.0  -21.2 

K/s-3  .21  .09  -15.9  -25.0 


* 

CD 

ro 

.22 

.11 

-11.0 

-27.1 

-18.7 

YJ  s(a-.5) 

.22 

.11 

-20.0 

-29.1 

-18.8 

K/a(s-l) 

.22 

.11 

-20.0 

-30.3 

-19.0 

Controlled 

element 


Score 


(cm2) 


rr 

me  as ’are  d 

.16 

K 

model 

•  i8 

K/s 

measured 

.072 

model 

.073 

K/s-3 

measured 

model 

.51 

K/s2 

measured 

.29 

model 

■  29 

V  !  c  (  a  _  C  'l 

me  as  lire  d 

model 

K/s/(s-l) 

measured 

.98 

model 

.97 

l  2t  2\ 
(cm  /sec  ) 


19.1+ 


•  87 


.82 


5.0 


5.2 


2.0 


Controlled 

Subjective  rating  effort  scale 

element 

mean 

st. dev. 

K 

-1.40 

.72 

K/s 

-1 .18 

.57 

K/s-3 

.49 

.53 

K/s2 

-.76 

.73 

* 

CD 

CD 

VJI 

.11 

.59 

K/s(s-1 ) 

.55 

.73 

Table  5  Normalized  subjective  ratings. 

Averaged  over  subjects  and  replications 


Frequency  domain  measures  -  Y  *  K 
Average  of  4  subjects,  3  trials/subject 


Frequency  domain  measures  -  Y  *  K/s-3 

c 

Average  of  U  subjects,  3  trials /subject 


Frequency  domain  measures  -  Y  =  K/s 
Average  of  4  Bub jects ,  3  trials/subject 


Fig.  7  The  relationship  between  subjective  ratings  and  coaputed  workload 
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ABSTRACT 

A  digital  computer  program  has  been  written  which  calculates  the  pilot 
parameters  necessary  to  satisfy  the  Neal-Smlth  flying  qualities  criteria 
proposed  in  Reference  1.  With  the  use  of  this  program,  an  evaluation  is 
made  of  the  effect  on  flying  qualities  of  variations  in  bandwidth  frequency 
and  maximum  allowable  droop  in  the  closed  loop  pitch  amplitude  ratio. 


INTRODUCTION 

A  closed  loop  handling  qualities  criteria  was  proposed  for  the  pitch 
tracking  task  in  Reference  1  in  which  pilot  generated  gain  and  lead  or  lag 
was  applied  to  the  open  loop  flight  control  system  (FCS)  and  airframe  transfer 
function  of  pitch  angle  to  stick  force  in  such  a  manner  as  to  satisfy  certain 
requirements  on  a  Nichols  Chart  of  closed  loop  amplitude  and  phase.  The 
block  diagram  for  the  pitch  tracking  task  is  shown  in  Figure  1. 
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To  satisfy  the  criteria  in  Reference  1,  a  plot  of  amplitude  vs  phase 
for  the  open  loop  transfer  function  0/0e(s)  is  superposed  on  a  Nichols  Chart 
and  the  values  of  Kp,  xp .,  and  are  adjusted  to  make  the  point  on  the 
plot  corresponding  to  a  stipulated  "bandwidth",  frequency  fall  on  the  closed 
loop  phase  curve  of  $c  ■  -  90®.  (The  values  of  bandwidth  frequency  suggested 
in  Reference  1  for  fighter  airplanes  were  3.0  and  3.5  radians  per  second, 
depending  on  the  aircraft  speed.)  Simultaneously,  the  minimum  closed  loop 
amplitude  for  frequencies  below  the  bandwidth  frequency  is  held  to  -3  dB. 

This  amplitude  is  referred  to  as  "droop".  Figure  2  depicts  a  typical  closed 
loop  Bode  plot,  ehowing  droop,  resonance,  and  bandwidth. 

When  these  two  criteria  are  met,  the  maximum  closed  loop  amplitude,  or 
resonant  peak,  is  obtained  from  the  Nichols  Chart  and  this  value,  along  with 
the  degrees  of  pilot  lead  or  lag  required  to  meet  the  criteria,  determine 
the  level  of  flying  qualities  for  the  aircraft  being  considered.  The  effect 
of  closed  loop  resonance  and  pilot  lead  or  lag  on  levels  of  flying  qualities 
is  shown  in  Figure  3,  along  with  typical  pilot  comments  to  be  expected  in 
each  portion  of  the  plot.  Essentially  the  magnitude  of  the  resonant  peak  is 
a  measure  of  the  tendency  of  the  aircraft  to  bobble,  oscillate,  or  PIO  on 
target.  The  lead  or  lag  compensation  is  a  measure  of  the  pilot  workload. 


The  basis  for  establishing  the  closed  loop  criteria  was  a  series  of 
variable  stability  T-33  flights  in  which  the  primary  task  was  pitch  attitude 
tracking  representative  of  up-and-away  tasks  associated  with  air-to-air 
combat.  The  tasks  were  performed  at  250  and  350  knot  airspeeds. 

Because  the  data  correlation  in  Reference  1  was  performed  by  a  tedious 
graphical  process  of  overlaying  open  loop  amplitude  vs  phase  plots  on 
Nichols  Charts,  it  was  not  possible  to  fully  assess  the  effects  of  bandwidth 
and  droop  on  data  correlation.  It  was,  however,  found  that  good  correlation 
was  obtained  when  a  bandwidth  frequency  of  3.0  radians  per  second  was  used 
with  the  250  knot  data  and  3.5  radians  per  second  was  used  with  the  350 
knot  data.  The  droop  amplitude  value  was  set  at  -3  dB. 

Subsequent  to  the  study  in  Reference  1,  a  digital  computer  program  was 
written  which  calculates  the  pilot  generated  gain,  lead,  and  lag  necessary 
to  satisfy  the  criteria  for  any  input  values  of  bandwidth  frequency  and 
droop,  and  for  any  set  o-  aircraft  plus  FCS  dynamics.  In  addition,  the 
program  computes  the  closed  loop  resonance  and  the  frequencies  at  which 
droop  and  resonance  occur.  The  program  is  documented  in  Reference  2. 

With  the  use  of  this  program,  it  is  now  possible  to  vary  the  nominal 
bandwidth  and  droop  values  used  in  the  criteria,  and  note  their  effect  on 
the  location  of  the  Figure  3  plot  of  resonance  vu  lead/lag  compensation. 

This  not  only  permits  a  better  correlation  with  a  given  data  base,  but 
allows  us  to  examine  the  concept  of  the  pilot  as  an  optimum  controller 
(Reference  3);  i.e.,  he  might  select  other  than  nominal  values  of  bandwidth 
and  droop  if  he  could  significantly  lower  the  resonance,  thereby  improving 
his  performance,  or  reduce  the  lead/lag  compensation  necessary,  thereby 
reducing  his  workload. 


BANDWIDTH 

Figures  4  through  22  depict  closed  loop  resonance  vs  pilot  generated 
lead/lag  for  several  configurations  from  Reference  1,  as  a  function  of 
different  values  of  bandwidth  frequency  and  droop  used  to  satisfy  the  Neal- 
Smith  criteria.  The  values  of  droop  are  presented  as  amplitude  instead  of 
log  magnitude.  On  this  scale,  .79  is  approximately  -2  dB,  .71  is  approximately 
-3  dB,  .63  is  approximately  -4  dB,  etc.  We  will  speak  of  lower  values  of 
amplitude  representing  increasing  droop. 

The  bandwidth  frequency,  defined  as  that  frequency  at  which  the  closed 
loop  phase  first  exceeds  -90°,  is  a  measure  of  how  aggressively  the  pilot 
wishes  to  perform  the  tracking  task.  If  he  detects  a  tracking  error,  it 
is  a  measure  of  how  rapidly  he  wishes  to  correct  the  error. 

It  is  obvious  that  in  many  cases  a  small  variation  in  bandwidth  can 
have  a  drastic  effect  on  resonance  and/or  pilot  generated  phase  compensation. 

It  follows  that  the  proper  selection  of  bandwidth  for  the  evaluation  of 
handling  qualities  is  critical.  This  fact  is  recognized  in  Reference  4 
where  the  value  of  bandwidth  is  made  a  function  of  aircraft  class,  flight 
phase  category,  and  level  of  flying  qualities,  as  defined  in  Reference  5. 
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Figures  4  through  16  represent  several  cases  from  Reference  1  in 
which  the  pilot  ratings  and  comments  seem  to  correlate  rather  well  with 
the  proposed  boundaries  of  Figure  3.  Since  a  bandwidth  of  3.0  radians/sec 
was  selected  for  the  250  knot  configurations  and  3.5  radians/sec  was  selected 
for  the  350  knot  cases,  it  is  probable  that  the  pilot  was  trying  to  achieve 
a  bandwidth  somewhere  between  these  two  values  for  most  configurations  in 
Reference  1.  In  several  cases,  a  dramatic  decrease  in  resonance  and  thus  an 
improvement  in  flying  qualities  would  result  if  the  pilot  were  willing  to 
decrease  his  bandwidth  from  3.0  to  2.5.  This  is  especially  true  in 
configurations  IE,  4D,  4B,  and  4C.  It  seems  remarkable  that  the  pilot 
is  apparently  unwilling  to  do  this. 

Figures  17  through  19  depict  configurations  for  which  pilot  ratings 
and  complaints  of  oscillatory  or  PIO  tendencies  appear  more  severe  than 
would  be  predicted.  It  may  be  that  the  pilot  is  striving  for  a  higher 
bandwidth  than  that  used  to  correlate  the  data. 


DROOP 

The  amount  of  droop  in  the  closed  loop  amplitude  vs  frequency  plot  is 
indicative  of  the  uniformity  of  response  to  inputs  of  varying  frequency.  A 
configuration  having  a  large  amount  of  droop  would,  for  example,  require  an 
increasing  amount  of  back  pressure  on  the  stick  to  hold  a  pitch  rate  after 
initially  responding  to  a  step  input. 

Configurations  6A,  4A,  and  5A,  shown  in  Figures  20  through  22,  are 
characterized  in  Reference  1  as  having  significantly  better  ratings  and  less 
problems  with  oscillatory  or  PIO  tendencies  than  would  be  predicted. 
Configuration  6A  has  the  most  pronounced  decrease  in  resonance  for  an  increase 
in  droop  of  any  configuration  examined,  and  it  appears  that  the  pilot  is 
accepting  a  slight  increase  in  droop  over  the  nominal  -3  dB  to  significantly 
reduce  the  oscillatory  tendencies  of  the  aircraft. 

Configurations  4A  and  5A  both  require  lag  compensation.  A  very  tentative 
hypothesis  might  be  that  the  pilot  will  increase  the  droop  (and  possibly 
lower  the  bandwidth  slightly)  when,  by  so  doing,  he  not  only  lowers  the  peak 
resonance  but  also  decreases  his  workload  by  decreasing  the  magnitude  of  the 
phase  compensation.  Note  that  in  the  case  of  lead  compensation,  increasing 
the  droop  has  the  effect  of  increasing  the  lead  compensation  and  hence  the 
pilot  workload.  In  support  of  this  very  tenuous  hypothesis,  data  is  pre¬ 
sented  from  Reference  6  in  Figures  23  through  29.  The  data  was  the  result 
of  a  fixed  base  simulation  of  flying  qualities  in  an  attitude  holding  task, 
and  the  pilot  ratings  were  based  on  the  old  Cooper  scale.  Because  of  the 
differences  in  the  simulations  in  Reference  1  and  Reference  6,  no  attempt 
will  be  made  to  validate  the  boundaries  on  Figure  3  using  this  data  base. 
However,  a  comparison  of  the  lead  and  lag  cases  shows  that,  assuming  a 
bandwidth  of  approximately  3.0  and  a  droop  amplitude  around  .71,  the  pilot 
ratings  for  the  lag  compensation  cases  appear  better  than  predicted,  whereas 
the  lead  compensation  ratings  seem  to  be  in  consonance  with,  or  worse  than, 
predicted. 
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DATA  BASE 


The  data  examined  from  Reference  1,  although  not  comprehensive,  are 
considered  to  be  representative  of  cases  which  satisfied  the  proposed 
boundaries  of  Figure  3,  as  well  as  cases  in  which  the  ratings  were  either 
worse  than  or  better  than  predicted.  Excluded  from  presentation  in  this 
paper  were  those  cases  for  which  ratings  were  worse  than  predicted  for 
reasons  not  pertaining  to  the  present  analysis.  Specifically,  the  anomaly 
in  cases  3A,  3B,  8A,  8B,  13  and  14  appears  to  be  better  explained  in  terms 
of  the  high  pitch-acceleration  sensitivity  of  these  configurations,  as 
explicated  in  Reference  1,  than  by  the  hypotheses  proposed  here. 

The  data  from  Reference  6  presented  here  in  support  of  a  hypothesis 
represents  all  the  data  examined  in  a  random  sample  from  this  data  base. 

It  is  felt  that  enough  cases  were  examined  to  lend  credence  to  the 
qualitative  nature  of  the  conclusions  drawn  from  the  data. 


CONCLUSIONS 

The  primary  purpose  of  this  paper  has  been  to  illustrate  a  data 
analysis  using  a  digital  program  for  varying  the  parameters  in  the  Neal- 
Smith  criteria.  Because  of  the  limited  data  base  and  the  subjective 
nature  and  variability  of  pilot  ratings,  any  conclusions  drawn  from  the 
analysis  regarding  the  data  base  have  to  be  regarded  as  very  tentative. 

With  this  admonishment,  the  following  conclusions  are  offered. 

1.  The  analysis  presented  here  points  up  the  extreme  sensitivity  of 
predicted  pilot  workload  and  oscillatory  or  PIO  tendencies  in  pitch  (in 
terms  of  the  parameters  in  Figure  3)  to  bandwidth  frequency.  The  proper 
selection  of  bandwidth  for  the  task,  flight  conditions,  and  class  of 
airplane  is  seen  to  be  crucial  to  the  successful  application  of  the  closed 
loop  criteria  in  Reference  1. 

2.  It  appears  that,  for  the  tracking  task  in  Reference  1,  the  pilot 
is  unwilling  to  lower  his  bandwidth  for  poor  configurations,  even  when 
substantial  reduction  in  closed  loop  resonance  and/or  workload  would  result. 

3.  There  appears  to  be  some  tendency  for  the  pilot  to  rate  the  air¬ 
craft  better  than  predicted  for  a  combination  of  some  or  all  of  the  follow¬ 
ing  factors . 

a.  Lag  compensation  is  required.  This  generally  means  that 
increasing  the  droop,  in  addition  to  lowering  the  closed  loop  resonance, 
will  decrease  the  magnitude  of  phase  compensation  required. 

b.  The  sensitivity  of  closed  loop  resonance  to  changes  in  droop 
is  relatively  high. 

c.  The  predicted  rating  of  the  configuration,  using  nominal  values 
of  bandwidth  and  droop,  is  Level  3  or  near  the  Level  3  boundary. 

4.  It  is  felt  that  a  variation  of  parameter  analysis  such  as  presented 
here  is  a  useful,  even  necessary  supplement  to  the  closed  loop  criteria  of 
Reference  1.  Not  only  does  it  facilitate  a  determination  of  the  proper  values 
of  bandwidth  and  droop  for  application  of  the  criteria,  but  it  provides 
insight  into  anomalies  in  the  data. 
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FIGURE  3.  FLYING  QUALITIES  AS  A  FUNCTION  OF  CLOSED  LOOP  RESONANCE  AND  PILOT 

COMPENSATION 


FIGURE  4.  EFFECT  OF  BANDWIDTH  AND  DROOP;  REFERENCE  1  DATA,  CONFIGURATION  IE 
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FIGURE  8.  EFFECT  OF  BANDWIDTH  AND  DROOP;  REFERENCE  1  DATA,  CONFIGURATION  4B 


FIGURE  9.  EFFECT  OF  BANDWIDTH  AND  DROOP;  REFEREh!CE  1  DATA,  CONFIGURATION  4C 


FIGURE  14.  EFFECT  OF  BANDWIDTH  AND  DROOP;  REFERENCE  1  DATA,  CONFIGURATION  7E 


FIGURE  16.  EFFECT  OF  BANDWIDTH  AND  DROOP;  REFERENCE  1  DATA,  CONFIGURATION  12 


FIGURE  19.  EFFECT  OF  BANDWIDTH  AND  DROOP;  REFERENCE  1  DATA,  CONFIGURATION  7D 


FIGURE  21.  EFFECT  OF  BANDWIDTH  AND  DROOP;  REFERENCE  1  DATA,  CONFIGURATION  4A 
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FIGURE  23.  EFFECT  OF  BANDWIDTH  AND  DROOP;  REFERENCE  6  DATA,  CASE 


FIGURE  24.  EFFECT  OF  BANDWIDTH  AND  DROOP;  REFERENCE  6  DATA,  CASE 
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FIGURE  25.  EFFECT  OF  BANDWIDTH  AND  DROOP;  REFRENCE  6  DATA,  CASE  131 


FIGURE  29.  EFFECT  OF  BANDWIDTH  AND  DROOP;  REFERENCE  6  DATA,  CASE  332 
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TRACKING  WITH  HEAD  POSITION  USING 
AN  ELECTRO-OPTICAL  MONITOR 

by 

Bernard  A.  Chouet  and  Laurence  R.  Young 

Man-Vehicle  Laboratory 
Massachusetts  Institute  of  Technology 


Abstract 

An  electro-optical  head  position  monitoring  system  was 
designed  and  built  and  is  used  in  single  axis  and  three- 
axis  "hands  off"  control  tasks.  The  monitor  consists  of 
a  transparent  plexiglass  body-fixed  helmet,  provided  with 
a  set  of  eight  silicon  photo-detectors  sensing  pitch,  roll 
and  yaw  motions  of  the  head.  Two  light-emitting  diodes, 
attached  to  the  pilot's  helmet  liner,  provide  the  AC 
modulated  near  infrared  radiation.  Head  control  is  com¬ 
pared  with  conventional  manual  control  for  single  axis 
and  three  axis  tracking  tasks.  Both  performance  curves 
and  describing  functions  are  presented. 
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1.  INTRODUCTION 


The  use  of  head  position  as  a  control  effector  has 
been  suggested  and  implemented  for  a  variety  of  applications 
for  which  conventional  manual  control  is  impossible  or  un¬ 
desirable.  This  paper  describes  a  new  photoelectric  head 
monitor  system  and  its  integration  in  a  closed-loop  tracking 
situation  with  the  three-axis  moving  base  simulator  in  the 
M.I.T.  Man-Vehicle  Laboratory. 

The  head  monitor  serves  a  dual  purpose.  As  a  sensor  of 
head  rotation  in  three  axes,  it  allows  study  of  the  dynamics 
of  head  movement.  It  also  is  used  as  a  measure  of  three-axis 
head  rotations  for  control  purposes.  The  applications  of 
such  a  system  include  "hands-off"  attitude  stabilization  for 
astronaut  extravehicular  activity  or  control  of  systems  under 
high  acceleration  conditions. 

2.  THE  HEAD  MONITORING  SYSTEM 

The  concept  of  using  head  position  as  a  control  for 
mem's  attitude. was  investigated  by  Von  Renner  in  our  labor¬ 
atory  in  1970a  .  By  measuring  the  electromyograms  from  sets 
of  neck  muscles  with  surface  electrodes,  he  was  able  to  con¬ 
trol  the  position  of  a  rotating  chair  in  the  yaw  axis.  The 
subject  commanded  chair  velocity  by  simply  turning  his  head 
to  the  left  or  right.  However,  the  existence  of  a  large 
rotation  dead-band  (+45°)  and  the  complexity  of  the  signal 
conditioning  circuits  limited  the  feasibility  of  that  system 
as  a  whole. 

Many  ot^ieg  approaches  to  head  movement  measurement  have 
been  tried1'  '  1  including  acoustic,  electro-magnetic,  gyro¬ 
scopic  and  optical  configurations.  The  important  considera¬ 
tions  in  the  design  of  a  head  position  sensor  were  flexibility, 
reliability,  maintainability,  linearity  and  human  compatibility. 
By  human  compatibility  we  include  the  following: 

-The  monitor  should  not  interfere  with  visual  functions 

-The  monitor  should  not  interfere  with  normal  head 
movements 

-Attachments  on  the  head  should  be  minimized 

-A  lockout  device  should  permit  free  head  movements 
unrelated  to  control. 

An  electro-optical  system  was  designed  to  be  compatible 
with  these  constraints.  The  monitor  consists  of  an  astronaut 
helmet,  similar  to  the  Apollo  design.  This  piece  is  attached 
to  a  shoulder  fixture  and  the  head  is  free  to  move  within  it. 

A  set  of  eight  silicon  photodetectors  is  fitted  in  the 
helmet  wall  (Figure  la)  and  two  Light-Emitting  Diodes  (LEDs) 
are  attached  to  the  pilot's  helmet  liner  (Figure  lb).  The 
electronics  for  signal  processing  are  in  a  separate  box.  The 
helmet,  made  of  transparent  plexiglass,  was  designed  and  built 
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specifically  for  the  purpose  of  head  position  monitoring. 

Maximum  neck  mobility  and  anthropometric  characteristics  of 
the  head  typical  of.the  astronaut  population  were  considered 
as  design  factors 

As  shown  in  Figure  lb,  the  instrumentation  mounted  on 
the  pilot's  head  is  limited  to  the  two  LEDs.  One  LED  is 
attached  to  the  helmet  liner  on  the  top  of  the  head,  aligned 
with  the  head  vertical  axis,  and  is  used  for  the  measurement 
of  pitch  and  roll.  The  second  LED  is  set  on  the  back  of  the 
head  and  used  for  the  measurement  of  yaw  head  movements.  Each 
LED  has  an  emission  beam  angle  of  175°  between  half-gower 
points.  The  radiation  spectrum  is  centered  at  9300  A.  Each 
photodetector  has  a  directional  sensitivity  covering  a  solid 
angle  of  180°.  Pitch  and  roll  head  motions  are  sensed  by  a 
set  of  two  detectors  per  axis.  Direction  of  motion  is  deter¬ 
mined  by  phase  sensitive  demodulation  of  the  detector  pair  at 
the  1  kHz  frequency  of  LED  oscillation.  The  yaw  axis  has  a 
similar  arrangement,  although  it  includes  an  additional  two 
sensors  to  insure  a  monitor  output  saturation  level  when  the 
pilot  executes  large  turning  motions.  The  helmet  limits  head 
rotations  to  +20°  in  pitch  and  roll.  Head  movement  is  unlim¬ 
ited  in  yaw;  However,  the  monitoring  range  extends  to  only 
±60°;  (when  used  in  yaw  position  control,  the  monitor  is  pro¬ 
vided  sufficient  feedback  gain  so  that  the  pilot  need  not 
perform  large  head  movements) . 

The  system  operates  on  a  +15  volt  500  milliampere  power 
supply.  The  two  TIXL26  LEDs,  mounted  in  series,  are  AC  driven 
at  1  kH*  by  a  Colpitts  oscillator.  Eight  TIL65  phototransistors 
are  used  for  detecting  head  motion.  Each  axis  processing  circuit 
consists  of  a  preamplifier,  ring  demodulator  and  an  output 
isolation  operational  amplier.  The  three  demodulator  refer¬ 
ence  signals  are  provided  by  the  Colpitts  oscillator  which 
drives  the  LEDs.  The  monitor  output  for  each  axis  is  a  DC 
voltage  which  varies  within  the  range  +15  volt.  The  system 
time  constant  is  2  milliseconds  and  contains  a  measured  1.2% 
ripple.  The  electronics  are  shielded  from  electromagnetic 
interference.  Optical  shielding  of  the  helmet  from  ambient 
light  was  not  necessary  for  the  simulator  environment.  How¬ 
ever,  laboratory  experiments  showed  that  a  500  A  layer  of 
vacuum  deposited  aluminum  was  sufficient  to  cut  transmittance 
of  all  wavelengths  down  to  30%  without  significantly  reducing 
the  ability  to  see  through  the  visor.  A  detailed  description 
of  the  electronic  and  geometrical  characteristics  of  the  mon¬ 
itor  is  given  by  Chouet  .  A  view  of  the  monitoring  equipraent 
is  shown  in  Figure  lc. 

3.  SYSTEM  OUTPUT  DECOUPLING 


The  geometry  of  the  monitoring  system,  with  the  yaw  detectors 
placed  above  the  center  of  head  rotation,  leads  to  a  coupling  be¬ 
tween  the  roll  and  yaw  axes.  Furthermore,  most  natural  yaw  head 


movements  Involve  a  small  amount  of  roll  as  well.  Decoupling 
of  the  pitch,  roll  and  yaw  commands  was  realized  with  a  real  time 
PDP-8  computer  operating  on  the  monitor  output.  The  decoupling 
scheme  can  be  expressed  by  Equation  1: 
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or  in  a  condensed  vectorial  form: 
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The  angles  i b,  0  ,  and  $  represent  the  command  vector  for  yaw, 
pitch  and  roil  axes  respectively,  whereas  v.,  v0,  and  v  are  the 
measured  monitor  output  voltages  for  those  axes.  A  indicates  a 
change  in  the  command  vector  from  the  nominal  angles.  (Normally, 
the  nominal  angles  are  established  for  the  head  upright  and  look- 
straight  ahead) . 


The  six  coefficients  a. .  of  the  decoupling  matrix  A  must  be 
established  individually  for^each  pilot  wearing  the  monitor.  As 
an  example,  in  the  case  of  pure  pitch  motions,  we  would  want  the 
command  roll  and  yaw  to  be  zero. 
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To  accomplish  this,  we  define  the  cross-coupling  cost  function: 
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Minimizing  the  cost  function  with  respect  to  a 


/Tv0  dt 
0  0 


(4) 


*0 


gives: 


3  J, 


15a 


ii 


\pe 


¥  fVe** 


2a 


ii 


,T  2 .. 
/  vfldt 

0  0 


(5) 


Hence : 


'Vedt 


\pe 


/T  2 

o  vedt 


(6) 


And  similarly,  to  minimize  the  effect  of  pitch  motion  on  roll 
detection,  we  calculate  the  coefficient: 
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The  same  procedure  applied  to  pure  roll  and  pure  yaw  motions  leads 
to  similar  computations.  The  six  coefficients  are  summarized 
below: 
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The  head  motion  used  for  the  computation  of  the  coefficients  was 
a  natural,  approximately  sinusoidal,  swing  of  the  head  about  the 
axis  to  be  decoupled.  Several  cycles  were  taken  to  obtain  a  good 
average  value  for  each  factor.  The  basic  interval  of  computation 
was  thirty  seconds,  one  value  of  each  of  the  two  coefficients  in¬ 
volved  being  updated  every  five  seconds.  Convergence  was  then 
estimated  and  with  satisfactory  results  the  final  values  were  stored 
in  the  computer  memory  for  later  use  in  the  experiment.  The  accuracy 
of  each  decoupling  coefficient  depends  on  the  regularity  and  also 
the  amplitude  of  the  subject's  head  motions  during  the  computation 
procedure.  The  error  involved  in  the  linearization  process  was 
small,  however,  and  is  depicted  in  the  average  value  of  the  de¬ 
coupling  efficacy,  as  defined  in  the  next  section. 

aet  a<w  a04>  aM  ai*»e  a<j>e 

Average  Decoupling 

Efficacy  in  %  97.2  89.4  97.6  79.3  98.4  99.3 

(3  subjects) 

The  tightest  coupling  of  head  movement  was,  as  expected, 
between  yaw  and  roll  head  movements.  Subjects'  relative  inability 
to  make  a  pure  yaw  or  roll  head  movement,  combined  with  the  geo¬ 
metric  factors  of  detector  placement  to  make  the  decoupling  prob¬ 
lem  most  severe  about  these  axes.  However,  even  in  the  worst 
case  (coefficient  a, ,)  the  residual  coupling  between  the  roll  and 
yaw  axes  did  not  affect  the  subjects'  performance.  Typical  sen¬ 
sitivities  were  0.44  volts/deg.  in  yaw,  0.59  volts/deg.  in  roll 
and  0.72  volts/deg  in  pitch.  Linearity  is  about  2%  of  the  full 
scale  in  pitch  and  roll  and  6%  of  full  scale  in  yaw. 


4.  THE  EXPERIMENTS 

Three  subjects  were  used  in  the  experiments.  Two  of  them  (SY 


and  JD)  had  control  experience  in  dynamics  of  various  order,  in¬ 
cluding  one  case  (JD)  flying  a  light  airplane.  The  third  subject 
(DC)  had  no  experience  with  control  systems,  simulators  or  any 
vehicle. 

The  experiments  were  performed  using  the  three-axis  motion 
simulator  (modified  Link  GAT-1)  of  the  Man-Vehicle  Laboratory. 
Tracking  with  head  and  manual  control  were  compared  for  each 
separate  axis  in  compensatory  tasks.  The  ability  to  control  the 
attitude  of  the  vehicle  was  then  tested  for  both  manual  and  head 
control  in  three  axis  control  tasks. 

The  dynamics  of  the  trainer  in  yaw,  roll  and  pitch  were  mod¬ 
ified  to  approximate  a  rate  control.  The  compensated  dynamics  of 
the  trainer  in  each  axis  were  then: 

G(3)  =  s^oTls ~  1]  *  I  degree/volt 

The  monitor  assembly  was  fixed  to  the  back  of  the  vehicle  seat 
and  arranged  to  fit  each  pilot.  The  subjects  themselves  were  strap¬ 
ped  to  the  seat  and  the  head  was  free  to  move  with  respect  to  the 
body,  within  the  limits  of  the  helmet.  Thus,  we  roughly  simulated 
the  situation  encountered  by  an  astronaut  in  space,  where  the  head 
can  move  freely  with  respect  to  the  shoulders  inside  the  space  hel¬ 
met. 

The  trainer  and  monitor  were  linked  to  a  hybrid  PDP-8/GPS  Corp. 
290T  computer  system.  Compensation  circuits  were  wired  on  the  ana¬ 
log  section.  The  vehicle  faced  a  13  foot  radius  curved  screen  on 
which  its  motions  were  displayed  by  a  one  inch  wide  arrow  projected 
from  the  roof  of  the  trainer.  For  compensatory  tracking  tasks,  a 
fixed  target  was  set  on  the  screen,  consisting  of  two  red  strips, 
spaced  one  inch  apart.  The  subjects  were  provided  with  a  lockout 
switch  to  shut  the  system  off  in  case  of  an  emergency.  The  switch 
was  never  used. 


Single-Axis  Compensatory  Tracking  Tasks 

The  ability  to  control  the  vehicle  position  was  first  tested 
for  compensatory  tracking  tasks .  A  block  diagram  of  the  head  con¬ 
trol  is  shown  in  Figure  2.  Two  sets  of  pseudo-random  input  distur¬ 
bances  were  used.  Each  was  a  zero-mean  rectangular  spectrum  com¬ 
posed  of  16  sinusoids.  Bandwidths  were  0.295  Hz  and  1.55  Hz.  Each 
control  axis  was  tested  separately.  While  one  motion  was  being 
studied,  the  two  other  vehicle  axes  were  locked  out  by  a  position 
control  to  avoid  any  bias  due  to  rotational  cross-coupling.  Tne 
nead  monitor  outputs  were  scaled  at  +  10  volts,  the  computer 
generated  decoupled  command  signals  in  the  range  of  +  2.5  volts. 

In  manual  control,  the  actuator  was  a  three-axis  single  arm 
spring  restrained  stick,  characterized  by  +  7  volt  maximum  output 
levels.  The  range  of  disturbance  amplitudes  was  also  limited  to 
+  7  volts.  On  the  yaw  axis,  the  result  was  a  maximum  rotation,  in 
the  absence  of  control  of  about  three  full  revolutions,  with  typical 
maximum  angular  velocities  of  15  to  20°/sec.  Pitch  motions  were 
within  the  trainer  limits  of  16°  up  and  10°  down,  with  maximum 


velocities  of  20°/sec.  Maxiirum  roll  motion  was  set  to  +  12.5°, 
restricted  by  the  trainer  limits,  and  peak  roll  velocities  were 
similar  to  those  in  pitch. 

The  subjects  were  only  instructed  to  maintain  the  vehicle's 
position  with  respect  to  the  visual  reference  on  the  screen,  by 
head  or  stick  movements.  Their  comments  were  recorded  and  sug¬ 
gestions  for  adjustment  of  the  helmet  were  implemented.  A3 1 
tracking  runs  were  of  three  minutes  duration,  with  a  five  minute 
rest  between  each  of  them.  Before  the  tests  started,  the  sub¬ 
jects  were  given  several  practice  runs  to  familiarize  themselves 
with  the  system.  Data  were  then  taken  for  the  next  series  of 
experiments.  Chart  records  were  obtained  of  the  random  input, 
head  command  signals,  vehicle  position  output,  Integrated  Squared 
Input  (ISI)  and  Integrated  Squared  Vehicle  Position  Error  (ISVPE) . 
The  ratios  of  ISVPE  to  ISI  provided  us  with  performance  indices 
to  compare  individual  runs  and  intrasubject  performance.  Simil¬ 
arly,  the  two  other  monitor  outputs  were  squared  and  integrated 
over  the  entire  length  of  a  run  and  then  divided  by  the  ISI.  These 
ratios  were  used  to  define  the  decoupling  efficacy  of  the  computer 
program;  (a  ratio  of  zero  represents  an  efficacy  of  one  hundred 
percent,  whereas  a  ratio  of  one  or  higher  represents  an  efficacy  of 
zero  percent) .  In  parallel  with  the  decoupling  task  and  the  com¬ 
putation  of  the  integrated  squared  signals,  as  well  as  performance 
indices,  the  program  could  be  used  to  include  various  thresholds 
in  the  monitor  output  characteristics. 

The  vehicle  velocity  output  and  the  five  chart  recorder  sig¬ 
nals  were  also  recorded  on  FM  magnetic  tape  for  later  describing 
function  analysis.  A  sample  of  chart  recorder  signals  is  shown 
in  Figure  3  for  the  yaw  position  control  in  the  case  of  the  low 
frequency  disturbance  input.  Subject  performance  curves,  shown  in 
Figure  4a-f,  were  established  as  a  function  of  the  open  loop  gain 
(the  product  of  monitor  gain,  computer  scaling  and  control  gain, 
with  trainer  gain  unity) .  The  corresponding  mean  Maximum  Peak  to 
Peak  Head  Motion  (MPPHM)  necessary  for  the  control  is  also  shown 
on  the  graphs.  For  compariscn,  performance  curves  of  the  three 
subjects  in  manual  control  are  given  in  Figure  5a-f,  over  a 
similar  range  of  open  loop  gains.  (No  direct  comparison  of  gains 
in  deg/deg  has  been  made.  Notice  the  insensitivity  of  performance 
to  gain  for  stick  control,  and,  to  a  much  lesser  extent,  for  head 
control) .  The  Performance  Indices  (PI)  at  the  optimum  gain,  for 
each  subject  are  summarized  in  Table  1. 


Table  1.  Compensatory  Tracking  Tasks:  Summary  of  Results 

Head  Control 

Subject  PI -Low  Frequency  Pi-High  Frequency 


Yaw 

Pitch 

Roll 

Yaw 

Pitch 

Roll 

JD 

0.075 

0.104 

0.342 

0.083 

0.086 

0.930 

SY 

0.085 

0.049 

0.299 

0.156 

0.078 

1.300 

DC 

0.131 

0.071 

0.810 

0.181 

0.096 

1.500 

Manual 

Control 

ibject  Pi-Low  Frequency 

Pi-High  Frequency 

Yaw 

Pitch 

Roll 

Yaw 

Pitch 

Roll 

JD 

0.044 

0.043 

0.029 

0.058 

0.049 

0.107 

SY 

0.033 

0.046 

0.191 

0.123 

0.064 

0.434 

DC 

0.209 

0.068 

0.143 

0.379 

0.103 

0.289 

Close  scrutiny  of  the  Table  1  figures /  as  well  as  comparison 
of  the  performance  curves  of  each  control  in  each  axis,  reveals 
marked  similarities  between  the  two  systems.  Comparatively  poorer 
results  were  obtained  in  head  control  about  the  roll  axis.  In 
normal  daily  activity,  voluntary  head  movements  are  primarily  in 
the  yaw  and  pitch  planes .  The  absence  of  any  need  to  maintain 
any  specific  roll  orientation  of  visual  fields  limits  most  roll 
head  movements  to  postural  reactions  keeping  the  head  upright, 
and  to  quasi  static  tilts,  as  for  example,  those  needed  to  orient 
the  head  with  respect  to  the  lines  of  print  in  a  tilted  book.  It 
is  hardly  surprising,  therefore,  that  unpracticed  subjects  found 
greater  difficulty  in  using  voluntary  control  of  roll  head  position 
than  for  motion  about  the  other  axes.  Furthermore,  the  location 
of  the  suspension  point  below  the  neck  in  this  experiment  contri¬ 
buted  possible  biomechanical  cross-coupling  between  linear  accel¬ 
eration  and  head  movement  control  for  pitch  and  roll  (the  trainer 
pitch  and  roll  axes  were  three  feet  below  the  subject's  head). 

The  sign  of  the  inertial  reaction  of  the  head  to  a  roll  or  pitch 
acceleration  is  in  the  correct  direction  for  stabilization,  how¬ 
ever,  and  no  systematic  study  of  the  influence  of  the  cross- 
coupling  was  undertaken.  Except  for  the  roll  axis,  the  head 
motion  control  compared  favorably  with  manual  control.  The  human 
compatibility  of  head  movement  control,  especially  in  yaw,  was 
noted.  Optimal  performances  were  obtained  for  ranges  of  head 
angles  of  +  15°  to  +  25°  in  yaw,  +  11°  to  +  17°  in  roll,  and 
+  6°  to  +  13°  in  pitch.  The  subjects  did  not  complain  about  visual 
interaction.  It  is  probable  that  single  axis  hand  motions  are 
more  precise  than  head  motions  when  the  error  to  be  compensated 
becomes  small. 

Describing  Functions 

The  human  operator's  describing  functions  for  manual  and  head 
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control  in  closed-loop  compensatory  tracking  tasks  were  obtained 
using  a  Fast  Fourier  Transform  (FFT)  program.  Samples  were  taken 
from  the  data  stored  on  magnetic  tape  during  the  previous  experi¬ 
ments  and  processed  on  the  PDP-8  digital  computer.  To  avoid 
initial  transient  artifacts,  the  sampling  of  the  pilot's  input 
and  output  (i.e.  the  trainer  position  error  (to  ,  0  ,  <J>  )  and  the 
control  head  or  manual  signal  (n  ))  was  made  only  in  thl  middle 
portion  of  the  run.  Low  frequency  disturbance  experiment  data 
were  taken  every  0.25  second  for  128  seconds.  For  the  high  fre¬ 
quency  disturbance  runs,  the  sampling  period  was  0.0625  seconds 
for  32  seconds  of  record.  Only  the  specific  frequency  components 
of  the  random  input  were  considered  in  calculating  the  describing 
function  Y  ( jw) .  All  the  graphs  were  established  for  the  approx¬ 
imate  moving  base  vehicle  dynamics  Y c(s)  =  K/s  for  the  three  axes 
in  both  head  and  me  mal  control.  ThSse  graphs  are  presented  in 
Figures  6a-f.  Over  plots  of  1 1/Y  |  are  drawn  on  each  describing 
function.  The  crossover  frequencies,  indicated  by  the  intersection 
of  the  1 1/Y  |  and  the  j Y  |  curves,  are  presented  in  Table  27.  For 
the  yaw  axis  the  slightly  better  performance  with  stick  control 
seen  in  Table  1,  is  not  reflected  in  a  difference  in  crossover 
frequency.  The  higher  crossover  frequencies  in  pitch  and  roll 
manual  control,  compared  to  yaw  are  consistent  with  the  additional 
motion  cues  available  through  graviceptor  stimulation1' ' 8 .  The 
lower  crossover  frequency  seen  for  roll  head  control ,  compared 
to  roll  stick  control  is  reflected  in  the  higher  PI,  as  discussed 
above . 


Table  2. 

Yaw 

Pitch 

Roll 


Crossover  Frequencies 

Head  Control 
3.0  rad/sec 
4 . 6  rad/sec 
3.0  rad/sec 


Three-axis  Control 


Manual  Control 
3.0  rad/sec 
5.5  rad/sec 
5.0  rad/sec 


Precision,  speed,  stability,  smoothness  and  human  compat¬ 
ibility  of  both  manual  and  head  piloting  were  compared  in  a  three 
axis  task.  The  block  diagram  for  this  experiment  is  the  same  as 
in  Figure  2  with  the  disturbance  removed;  instead,  a  step  is 
applied  to  the  reference.  Four  targets  were  established  on  the 
screen.  Reaching  each  of  these  required  the  use  of  the  three 
degrees  of  rotational  freedom  of  the  trainer.  The  target  dispos¬ 
ition  is  given  in  Table  3,  with  rotation  in  the  order  of  yaw, 
pitch  and  roll. 


Table  3.  Target  Positions 


Position 

Yaw 

Pitch 

Roll 

Target  "0" 

0° 

0° 

0° 

Target  "1" 

150°  left 

11°  up 

12°  left 

Target  "2" 

53°  left 

13°  up 

3°  left 

Target  "3" 

90°  left 

10°  down 

12°  right 
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As  for  compensatory  tracking  tasks,  each  target  was  made  of  two 
red  strips  clearly  visible  on  the  white  background  of  the  screen, 
and  the  projected  spot,  a  vertical  arrow,  was  to  be  set  in  between 
these  markers. 

The  pilots  were  required  to  minimize  the  traveling  time 
between  the  targets  on  the  screen  and  to  stabilize  their  position 
within  the  target  limits  (+  45  arc  min)  for  at  least  fifteen  sec¬ 
onds.  Stability  was  estimated  visually  by  the  experimenter  and 
clearance  to  leave  for  the  next  spot  was  communicated  to  the  pilot 
when  the  result  was  judged  satisfactory.  The  subjects  were  left 
free  to  practice  with  the  system  as  long  as  they  desired,  (about 
ten  minutes)  and  the  feedback  gains  were  varied  until  near  opti¬ 
mal  conditions  were  reached.  The  three  head  monitor  control  out¬ 
puts  were  decoupled  and  +  1°  rotation  thresholds  were  inserted  in 
the  commands  to  help  the  subjects  in  zeroing  their  head  position. 
Typical  time  plots  of  the  trainer  trajectory  are  shown  in  Figure 
7a-b.  As  seen  on  these  plots,  head  control  led  naturally  to 
simultaneous  motions  about  the  three  axes.  By  looking  in  the 
right  direction,  the  subjects  were  taking  the  shortest  path  from 
one  target  to  the  next.  As  they  kept  their  head  aimed  at  their 
destination,  the  position  error  between  head  and  helmet  gradually 
decreased  following  the  trainer  motion.  A  few  corrections  were 
then  made  in  the  vicinity  of  the  target  to  lock  into  the  required 
position.  Starting  from  one  spot  and  locking  into  another  gener¬ 
ally  took  ten  to  fifteen  seconds.  No  significant  differences 
were  noted  between  the  subjects,  and  all  of  them  were  able  to 
stabilize  on  each  target  as  long  as  needed.  With  the  stick, 
however,  the  motions  were  clearly  sequential.  Knowing  their 
destination,  the  subjects  generally  estimated  which  axis  re¬ 
quired  the  largest  displacement  and  started  moving  about  that 
particular  axis  first.  A  new  estimation  was  then  made,  followed 
by  another  decoupled  move,  and  so  or.;  in  Figure  7b  for  example, 
we  see  that  the  subject  started  from  target  "0"  with  a  yaw,  then 
made  a  pitch  and  finished  with  a  roll.  This  behavior  resulted  in 
a  longer  path  between  the  targets,  but  the  total  amount  of  time 
spent  traveling  and  stabilizing  was  about  the  same  as  for  head 
control,  at  least  for  two  subjects,  one  pilot  being  unable  to 
stabilize  on  target  "2". 

CONCLUSION 

From  an  engineering  point  of  view,  the  head  monitoring 
system  performed  well,  was  very  reliable,  and  proved  flexible 
enough  to  accommodate  each  pilot.  The  subjects  found  it  com¬ 
fortable,  although  some  complained  about  the  loss  of  freedom 
in  their  head  position.  Non-linearities  within  the  monitor's 
output  were  minimal.  The  subjects  showed  somewhat  better  track¬ 
ing  performance  in  single  axis  manual  control  than  with  the  head 
control.  In  a  three  axis  configuration,  the  head  control  led  to 
more  efficient  synchronized  motion  than  the  manual  control.  To 
this  advantage  is  added  the  fact  that  this  type  of  control  leaves 
the  hands  free. 
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(c)The  Monitoring  Equipment 


Figure  2  -  Block  Diagram  of  the  Head  Control  Experiment 
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Figure  6a  -  Describing  Functions  for  Head  and  Stick  Control  with  Visual  and  Motion  Cues 
Plant  Dynamics  Yc(s)  »  K/s.  (Head  Yaw  Control) 


Figure  6f:  Describing  Functions  for  Head  and  Stick  Control  with  Visual  and  Motion  Cues 
Plant  Dynamics  Y  (s)  =  K/s.  (Stick  Roll  Control) 


Figure  7a  -  Three  Axis  Trajectories,  Head  Control  (Yaw  Trajectory  Indicates  Sine  of  the  Yaw  Angle) 
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ABSTRACT 

Present  artificial  arms  do  not  provide  sensory  feedback  Information 
such  as  pressure  and  temperature,  elbow  and  wrist  angular  position,  etc. 

This  paper  will  be  concerned  with  closing  the  loop  between  the 
amputee,  his  prosthesis,  and  the  environment,  by  providing  a  basic 
general  pattern  for  generating  sensory  feedback  Information. 

A  model  of  a  neuromuscular  receptor  In  the  feedback  loop  of  the 
peripheral  neuromuscular  system  was  constructed  from  experimental  data. 
Functional  analysis  of  the  model  resulted  In  undertaking  efforts  at 
three  levels;  development  of  a  pressure  sensitive  electro-mechanical 
transducer,  electronic  simulation  of  neural  sensory  element  discharge 
patterns,  and  the  Interface  network  of  the  system  with  the  amputee. 

Methods  of  Implementation,  including  skin  stimulation  as  well  as 
various  subcutaneous  stimulations,  are  discussed. 
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INTRODUCTION 


Lack  of  sensation  from  the  terminal  device  of  upper  extremity 
prostheses  is  a  factor  that  may  lead  some  amputees  to  abandon  their 
prostheses  shortly  after  fitting,  or  to  use  them  primarily  for 
cosmetic  purposes. 

it  is  logical  that  the  addition  of  some  kind  of  subconscious 
direct  sensory  feedback  to  the  amputee  will  result  in  improved 
overall  adaptation,  performance  and  control.  Direct  subconscious 
sensation  will  bring  about  reduction  in  training  time,  an  increase 
In  controllability  of  the  prostheses  trajectories,  a  reduction  of 
required  visual  supervision,  and  will  produce  the  psychological 
effect  of  making  the  prosthesis  become  more  "human."  The  mental 
burden  of  operating  the  prosthesis  will  be  reduced  to  a 
subconscious  level,  especially  if  EMG  command  signals  are  used  to 
generate  control. 

Several  attempts  have  been  made  in  the  past  to  provide  sensory 
features  to  upper  extremity  prostheses.  The  most  recent  successful 
attempt  was  made  by  Ciippinger,  et  ai.  (1973)  at  Duke  University, 
in  a  pilot  study,  implant  procedures  were  used  to  relay  signals 
extracted  from  strain  gages  on  mechanically  controlled  prostheses 
to  the  median  nerve  in  a  proportional  mannsr.  Two  encouraging 
results  were  obtained  from  this  experiment:  First,  the  central 
nervous  system  is  capable  of  being  stimulated  externally  by  a 
peripheral  nerve  In  a  manner  that  forms  a  mental  Image  of  force  at 


the  terminal  device  that  is  proportional  to  the  actual  force.  Second, 
implant  procedures  of  stimulating  sensory  nerve  fibers  subcutaneously 
proved  to  be  successful. 

In  light  of  the  evidence,  it  seems  that  the  foundation  for 
further  work  is  established.  However,  several  engineering  problems, 
mainly  Involving  external  transducer  and  electronic  design,  still 
require  solution. 

This  paper  presents  a  system  for  the  sensory  feedback  loop  of  a 
prosthetic  terminal  device  which  is  capable  of  sensing  grasp  pressure. 
The  relevant  characteristics  of  the  neuromuscular  sensory  feedback 
system  provide  conceptual  guidance  to  this  approach.  Electronic 
simulation  of  a  biological  neural  element  discharge  pattern  Is  used 
to  stimulate  selected  skin  areas,  while  sensory  input  is  provided  by 
pressure  sensitive  transducers. 

MODEL  OF  A  NEUROMUSCULAR  SENSORY  RECEPTOR 

The  neuromuscular  system  could  be  described  In  engineering 
terminology  as  a  closed  loop  control  system.  The  neural  motor 
activity  and  muscle  dynamics  (contractlon/elongatlon)  form  the  forward 
loop,  with  the  muscle  spindle  receptor  as  the  feedback  element 
monitoring  elongation  and  its  rates.  The  a  motoneurons  of  the  spinal 
cord  constitute  the  summation  point  and  error  signal  generator 
(Figure  I). 

In  order  to  reconstruct  the  feedback  loop.  It  is  necessary  to 
define  the  characteristics  of  the  muscle  spindle. 
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THE  NEUROMUSCULAR  SYSTEM:  PHYSIOLOGY 


FIGURE  I  (a) 
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Earlier  work  (Solomonow,  1972)  defined  some  of  the  characteristic 
behavior  of  the  spindle  Impulse  firing  upon  muscle  elongation.  The 
frequency  of  the  Impulses  was  directly  related  to  the  elongation  (X), 

e 

and  to  Its  rate  (X).  Several  typical  recordings  from  the  efferents  of 
the  muscle  spindle  are  given  In  Figure  2.  The  final  steady  state 
discharge  frequency  Indicates  the  elongation,  while  the  Initial 
transient  frequency  increase  indicates  the  rate  of  elongation. 


TYPICAL  DISCHARGE  PATTERN  OF  THE  MUSCLE  SPINDLE 

FIGURE  2  (a) 
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X  «  0.^8  CM 
R  -  2.1  CM/SEC 


Changes  in  frequency  of  the  transition  discharge  with  changes  in 
rate  of  extension  are  uniform  In  behavior.  The  top  curve  of  Figure  3 
shows  the  peak  frequencies  at  the  end  of  the  transition  period  for  1.5 
cm.  elongation  at  different  rates  of  stretching.  In  addition,  the 
frequencies  for  two  other  levels  of  elongation  are  given.  At  1.5  cm. 
elongation,  the  frequencies  appear  to  reach  a  limit  at  the  highest 
rate  of  extension.  Otherwise,  the  frequency  increases  regularly  as 
the  rate  of  extension  Increases  for  all  lengths  and  rates. 

THE  DYNAMIC  FREQUENCY 

At  the  end  of  the  transition  period,  the  frequency  response  will 
oscillate  for  a  few  milliseconds  and  quickly  reach  a  steady  value. 
During  the  first  second  or  two,  the  frequency  will  continue  to  decay 
slowly,  stabilizing  about  a  fixed  frequency  value  a  minute  later.  The 
impulses  will  continue  to  fire  at  this  frequency  for  prolonged  periods 
of  time  without  perturbation.  Plotting  the  dynamic  frequency  against 
levels  of  elongation  results  In  a  straight  line  of  slow  positive 
slope,  as  shown  in  Figure  4.  When  varying  the  rates  of  extension 
between  .2  and  4.7  cm/sec.  for  a  constant  level  of  extension,  no 
change  in  dynamic  frequency  Is  observed.  This  behavior  Implies  that 
the  dynamic  frequency  Is  Independent  of  the  rate  of  extension  being 
determined  by  the  level  of  elongation. 

To  conclude,  the  muscle  spindle  Is  a  mechano-efectrlc  transducer 
which  Is  capable  of  generating  Impulses.  The  impulses  translate 

e 

elongation  and  Its  rates  (X,  X)  Into  meaningful  electric  signals 


ELONGATION  (CM) 


DYNAMIC  FREQUENCY  INCREASES  LINEARLY  WITH  ELONGATION 

FIGURE  4 


transmitted  to  the  CNS  with  frequency  and  rate  of  change  of  frequency 

(f,  f),  as  the  variable  parameters.  The  feedback  element  could  be 

redrawn  to  Include  the  characteristic  behavior  of  the  spindle,  and  the 

•  • 

transformation  of  X,  X  Into  f,  f. 

RECONSTRUCTION  OF  THE  SENSORY  FEEDBACK  SECTION 

The  muscle  spindle  properties  discussed  above  can  be  simulated 


for  purposes  of  sensory  feedback  In  cases  of  peripheral  amputation, 
leprosy,  etc. 


Examination  of  the  spindle  structure  in  Figure  5  reveals  some  of 
the  characteristics  that  are  necessary  In  the  reproduction  of  sensory 
feedback.  The  spindle  consists  of  elastic  elements  embedded  in  the 
muscle  bulk.  It  serves  two  purposes: 

1.  Monitoring  the  mechanical  state  of  the  muscle,  l.e., 
elongation/contraction  and  their  rates  (X,  X),  which 
Indirectly  are  Indicators  of  the  associated  pressures. 

2.  Initiation  of  neuro-electric  signals  in  the  form  of  variable 
frequency  Impulses  with  the  Impulse  frequency  as  the 
controlling  variable. 


in  the  neuromuscular  system,  the  neuro-eiectric  signals  are 
Interfaced  via  the  dorsal  roots  to  the  peripheral  levels  of  the  central 
nervous  system  (CNS),  and  whenever  relevant  to  its  higher  centers. 

it  becomes  necessary  then,  for  reproduction  purposes,  to  construct 
three  distinct  subsystems,  i.e.,  a  device  which  is  capable  of 
monitoring  elastic  deformation  and  Its  rates,  an  information  transfor¬ 
mation  network  to  duplicate  the  variable  frequency  format  of  the  muscle 
spindle  discharge,  and  an  Interface  system  transmitting  the  information 
to  the  amputee.  The  Information  transformation  network  Is  intended  to 
be  controlled  by  the  deformation  monitoring  device.  A  reconstructed 
control  diagram  Including  the  above  elements  Is  shown  In  Figure  6. 

Several  methods  of  relaying  the  artificial  neuroelectric  signal  to 
the  CNS  exist.  Discussions  of  these  methods  appear  in  later  sections 
of  this  paper. 

The  monitoring  device,  situated  either  at  the  terminal  device  of 
the  prosthesis  or  at  any  of  the  degrees  of  freedom,  could  be  made  to 
monitor  a  variety  of  parameters,  viz.,  pressure,  temperature,  angular 
position  of  wrist,  elbow,  etc.  In  the  past,  attempts  were  made  to 
monitor  pressure  and  temperature  from  the  terminal  device  making  use  of 
strain  gages  and  thermocouples,  respectively.  Angular  position  of 
wrist  and  elbow  could  be  monitorled  by  a  variety  of  commercially 
available  potentiometers.  The  Information  transformation  system  is  the 
basic  component  of  this  feedback  system,  regardiess  of  the  controlling 
sensing  device  or  the  Interface  system.  Variables  such  as  pressure, 
temperature  and  position  can  be  converted  by  the  information 


transformation  system  Into  artificial  neural  pulses  of  changing  frequency 
of  the  range  0-120  pps.  The  strength  of  the  pulses  Is  dependent  on  the 
method  of  the  Interface.  For  example,  a  subcutaneous  neural  interface 
will  require  compliance  with  the  strength-duration  relationships  observed 
in  nerve  axons  (Katz,  1966),  while  skin  stimulation  requires  compliance 
with  Weber-Fechner  and  Stevens'  Laws,  as  well  as  findings  reported  by 
Prior  (1972),  with  strengths  of  over  100V. 

It  becomes  apparent,  then,  that  the  Information  transformation 
system  Is  to  contain  a  means  for  adjusting  both  pulse  width  and 
amplitude,  depending  on  the  stimulation  method  used. 

The  interface  of  the  system  with  the  amputee  is  of  major  importance, 
especially  with  respect  to  the  following  human  factors: 

1.  The  information  transmitted  to  the  amputee  should  be  on  a 
subconscious  level  In  order  to  decrease  the  mental  burden  and 
supervision  tasks. 

2.  The  Information  should  be  reliable  and  approximately 
I  ns tan taneous . 

3.  High  resolution  factors  should  be  achieved,  so  that  the  operator 
will  be  able  to  distinguish  minor  changes  In  the  state  of  his 
prosthesis. 

4.  The  method  of  Interface  should  be  safe;  no  skin,  nerve,  or 
muscle  should  undergo  deterioration  due  to  the  technique 
applied. 

5.  Easy  removal  and  application  procedure  should  be  arranged,  along 
with  continuous  comfort  while  applied. 
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6.  The  location  of  the  Interface  on  the  body  should  have  strong 
correlation  to  the  site  where  the  Information  was  monitored. 

In  the  past,  several  methods  of  Interfacing  Information,  such  as 
auditory  methods,  skin  vibration,  ctneplasty,  skin  pinch,  and  air 
pressure  on  the  skin,  were  attempted  without  success  due  to 
deficiencies  In  the  above  requirements  (Ciipplnger,  1973).  It 
becomes  obvious,  therefore,  that  future  solutions  to  the  Interface 
problem  should  resort  to  closely  duplicating  the  natural  physiologi¬ 
cal  method  of  relaying  sensory  Information,  i.e.,  nerve  stimulation 
or  electrical  skin  stimulation,  whenever  Invasive  implant  procedures 
are  not  feasible. 

Electrical  skin  stimulation  experiments  using  metal  electrodes 
(silver,  stainless  steel,  etc.)  show  that  this  method  of  Interface 
has  the  adverse  features  of  pain,  along  with  interference  with  EMG 
signal  detection,  whenever  used  with  myoeiectrtcal ly  controlled 
prosthesis.  The  first  feature  can  be  solved  by  using  recently 
developed  conductive  rubber  electrodes,  or  by  applying  generous 
amounts  of  skin  paste.  Locating  the  Interface  away  from  the  area 
where  EMG  Is  detected  will  eliminate  Interference;  nevertheless.  It 
may  become  difficult  for  the  amputee  to  associate  hand  pressure,  for 
example,  with  stimulation  In  areas  remote  from  his  artificial  hand 
(the  remote  locations  might  be  in  the  abdomen  or  the  opposite  hand). 
The  use  of  concentric  electrodes  partially  decreases  EMG  Interference, 
but  this  Is  not  the  best  solution  to  the  problem. 

A  general  procedure  In  generating  sensory  feedback,  Including 
various  approaches  of  monitoring  and  Interfacing,  is  shown  in 
Figure  7. 
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THE  SENSORY  FEEDBACK  SYSTEM 


THE  PRESSURE  TRANSDUCER 

Several  experimental  units  of  pressure  sensitive  elements  were 
constructed  at  the  Biotechnology  Laboratory.  Rubber  foam  pieces  were 
dipped  in  carbon  powder  and  Injected  with  liquid  latex.  Both 
materials  were  found  to  contribute  to  the  capacitance-resistance 
characteristics  of  the  transducer  when  used  in  various  amounts. 
Resistances  ranging  from  2  to  15  Kfl  could  be  established  for  combina¬ 
tions  of  carbon  powder- I iqu id  latex.  Generally  the  resistance  was 
observed  to  increase  with  increasing  amounts  of  liquid  latex. 

Typical  deformation-resistance  behavior  of  the  transducer  Is  shown  in 
Figure  d. 

The  unit  was  coated  with  a  room  temperature  vulcanizing  compound 
(RTV)  In  order  to  isolate  It  from  the  environment,  to  regulate  the 
pressure  range,  and  to  regulate  the  response  time.  Several  types  of 
RTV  were  used  to  coat  various  units,  resulting  in  different  unit 
response  characteristics.  The  type  of  RTV  used  and  the  thickness  of 
the  coating  influenced  response;  a  thick  coating  yieldeo  a  transducer 
which  sustained  larger  ranges  of  pressure,  along  with  better  recovery 
time.  The  last  parameter  is  an  important  one,  since  fast  recovery 
time  permits  perceptlcr*.  of  more  rapid  changes  of  pressure. 

Evaluation  of  the  type  of  transducer  we  have  described  has 
suggested  the  following  advantages: 

I.  The  possibility  of  shaping  the  element  in  a  fingertip  like 
form,  and  therefore  implementing  It  directly  at  the 
fingertips  of  a  prosthetic  hand  (see  Figure  9). 


TRANSDUCER 


THE  FINGERTIP  PRESSURE  TRANSDUCER 
FIGURE  9 


2.  Durability;  the  external  coating  of  the  RTV  can  be  made  In  any 
shape,  and  stands  up  well  to  temperature,  friction.  Impact, 
etc. 


3.  Large  ranges  of  deformation  pressures  are  feasible,  depending 
on  the  size  of  the  element  and  the  type  of  thickness  of  the 


RTV  coating.  Fine  pressure  ranges  are  desired  especially.  In 
order  to  allow  sensitivity  In  fine  activity  tasks. 


INFORMATION  TRANSFORMATION  ELECTRONIC  SYSTEM 

The  defined  function  of  this  system  Is  to  transform  pressure 
Information  Into  physiologically  meaningful  coded  sHnals.  At 
present,  the  output  of  this  system  Is  dependent  on  the  Interface  with 
the  amputee.  From  our  model  and  from  experienced  evolved  from  this 
field  In  recent  years  (Reswlck,  1972)  It  ts  well  known  that  both  skin 
and  nerve  fibers  can  be  stimulated  by  pulses  of  variable  frequencies 
In  the  range  between  10- tOO  pps.  Thus  a  reasonable  requirement  Is 
that  the  system  design  contain  a  basic  portion  transforming  the 
analog  pressure  Information  Into  pulses  over  the  range  of  10-100  pps. 
The  chosen  Interface  with  the  amputee  will  determine  the  Intermediate 
buffer  network  suitable  for  skin  or  nerve  stimulation. 

The  system  constructed  at  the  Biotechnology  Laboratory  consists 
of  the  following  components:  pulse  generator,  frequency  controller, 
and  pulse  width  controller.  The  schematic  Is  described  In  Figure  10. 


OUTPUT 


To 

Interface 


INFORMATION  TRANSFORMATION  NETWORK 
FIGURE  10 
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The  block  diagram  In  Figure  10  can  be  simply  realized  by  a  single 
semiconductor  and  several  passive  components,  as  shown  In  Figure  II. 
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SCHEMATIC  DIAGRAM  OF  INFORMATION  TRANSFORMATION  NETWORK 


FIGURE  II 


The  pressure  transducer  developed  was  substituted  for  as  the 
frequency  controlling  element. 

The  system  Is  simple,  and  could  be  easily  miniaturized  for 
Implementation  In  the  socket  or  the  forearm  portions  of  tho 
prosthesis:  a  power  supply  could  be  Included. 
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For  purposes  of  skin  stimulation,  a  transformer  was  Introduced  at 


the  output  of  the  pulse  generator  to  Increase  the  strength  of  the 
pulses  from  15V  to  200V,  with  a  potentiometer  output  for  adjusting  the 
pulse  characteristics  for  Individual  comfort,  as  shown  In  Figure  12. 
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FIGURE  12 


THE  INTERFACE 

Conductive  sponge  rubber  skin  electrodes  were  designed  and 
constructed  at  the  Biotechnology  Laboratory  In  a  concentric  fashion. 
A  circular  I -Inch  outer  diameter  p I  ex  I g I  as  plate  was  used  tc  house 
the  concentric  electrodes.  A  hole  was  drilled  In  the  center  of  the 
rod  where  a  cylindrical  piece  of  conductive  sponge  mounted  on  a 
copper  electrode  was  Inserted.  Another  cylindrical  electrode  nas 
mounted  on  a  copper  electrode  and  Inserted  1/2- Inch  away  from  the 
center,  as  shown  In  Figures  13  and  14. 


The  conductive  sponge  elements  were  exposed  .l-inch  below  the 
plexlgias  housing  for  contact  with  the  skin.  A  wire  was  drawn  from  each 
copper  electrode  and  connected  to  the  outputs  of  the  Information 
transformation  system. 

The  Interface  Illustrated  In  Figures  13  and  !4  Is  placed  on  the 
waistline  of  the  amputee  on  the  side  of  the  amputation.  It  Is  held  In 
place  by  connecting  the  plexiglass  housing  +-•>  the  waist  strap  of  the 
undergarment.  Electrode  skin  paste  Is  sparingly  applied  to  the 
electrode  to  Insure  good  contact.  The  waistline  location  was  chosen  to 
be  purposely  away  from  the  arm  and  shoulder  area  where  EMG  control 
recordings  were  done,  in  order  to  prevent  Interference  with  the 
myoelectric  signals. 

DISCUSSION 

Preliminary  testing  and  evaluation  of  the  system  for  several 
pressure  ranges  resulted  In  a  clear  vibration  sensation  on  the  skin, 
with  good  resolution  up  to  120  pps,  with  complete  comfort.  Several 
Important  points  were  revealed  during  the  experiment: 

a.  Except  for  a  slight  Initial  sting,  the  m3jor  part  of  the  pain 
component  observed  In  metal  electrodes  was  not  present. 

b.  As  pressure  applied  to  the  electrodes  against  the  skin  was 
Increased,  no  sting  or  discomfort  was  detected  at  any  phase. 

c.  Several  electrode  sizes  of  the  same  structure  and  design 
features  were  used,  revealing  that  more  comfort  Is  observed 
as  the  diameter  of  the  electrode  Increases. 


The  physical  phenomenon  behind  this  observation  lies  in  the 
decreased  current  density  generated  by  the  concentric  electrodes.  Since 
the  field  Just  outside  the  center  electrode  Is  proportional  to  the 
radius  of  the  electrode,  large  diameters  result  in  reduced  electric 
field  and  the  associated  current  density.  Smaller  current  densities 
effectively  reduce  the  sting/pain  effect,  and  result  in  Increased  com- 
fort.  Also,  as  the  pressure  on  the  electrodes  against  the  skin 
increases,  more  surface  contact  area  Is  available  for  the  current  to 
flow  through.  This  also  results  in  increased  comfort. 

Skin  stimulation  of  the  forearm  required  several  seconds  before 
sensation  was  detected,  while  stimulation  of  fingertip  or  abdomen 
resulted  in  Immediate  sensation.  Direct  placement  of  the  electrodes 
above  nerves  and  muscles  yielded  more  pronounced  vibration  sensation  due 
to  the  stimulation  of  the  organs.  The  above  observations  indicate  the 
variations  In  sensitivity  of  different  locations  of  the  body. 

In  conclusion,  the  above  findings  point  out  that  further  work  Is 
required  In  order  to  define  the  relationships  of  comfortable  sensation 
to  electrode  size,  contact  pressure  on  the  skin,  and  appropriate  loca¬ 
tion  of  the  electrodes  on  the  body.  Further  work  should  also  be  done  to 
define  the  waveform  for  which  skin  stimulation  results  In  maximal 
reduction  of  discomfort.  Interpretation  of  the  stimulus  does  not  seem 
to  be  a  serious  problem  at  this  time. 
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ABSTRACT 

This  paper  presents  a  method  of  deriving  system  performance 
models  by  applying  a  processing  model  to  demonstration  data.  The  approach 
is  an  empirical  one  in  which  data  representing  various  levels  of  performance 
are  examined  and  a  performance  model  is  automatically  constructed.  The 
technique  employs  a  transition  model  which  divides  the  problem  space  into 
discrete  cells  and  measures  performance  based  on  how  the  system  transfers 
from  cell  to  cell.  This  processing  model  is  applicable  to  many  problems 
because  it  is  based  on  output  demonstration  data  rather  than  a  description 
of  the  actual  control  task. 

This  performance  measurement  model  is  a  computer  program 
which  has  been  applied  to  flight  data  produced  by  operators  using  the  F-106 
simulator  located  at  AMRL/HES,  Wright- Patters  on  Air  Force  Base,  Ohio. 

The  paper  includes  descriptions  of  the  processing  models  and  the  resulting 
performance  measures  developed  from  the  F-106  simulator  data. 

INTRODUCTION 


Performance  of  manned  systems  is  limited  by  our  ability  to 
measure  system  and  component  subsystem  performance  in  a  reliable  and 
sensitive  manner.  Without  adequate  performance  measures,  there  is  no 
way  to  produce  and  test  system  designs,  plan  and  execute  training  systems, 
or  evaluate  operational  systems.  Methods  of  developing  these  performance 
measures  can  be  characterized  by  the  way  in  which  performance  criteria 
are  obtained.  Ideally,  performance  criteria  would  be  established  by  mathe¬ 
matical  techniques  to  ensure  a  firm  theoretical  basis.  For  example,  if  a 
problem  requires  that  an  aircraft  climb  to  a  specified  altitude  while  conserving 
fuel  during  the  climb,  the  criterion,  i.e. ,  minimization  of  fuel,  can  be 
precisely  defined.  Frequently,  however,  problems  can  not  be  solved 


♦This  work  was  supported  b"  6570th  Aerospace  Medical  Research  Laboratory, 
Air  Force  Systems  Command,  United  States  Air  Force,  Wright- Patterson 
Air  Force  Base,  Ohio. 
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analytically,  but  demonstrations  of  superior  as  well  as  less  than  superior 
performances  are  available.  In  this  situation,  we  find  that  man  can  demon¬ 
strate  good  (and  also  poor)  performance  even  though  he  is  unable  to  describe 
how  he  achieves  that  performance  or  what  criteria  he  uses.  Decision-making 
(policy),  flying  performance,  and  athletic  performance  are  a  few  of  the  areas 
in  this  category. 

This  paper  documents  an  empirical  approach  to  the  development 
of  system  performance  measures  whereby  flight  data  from  demonstrations  of 
various  performance  levels  are  systematically  processed  to  obtain  the  desired 
system  performance  information.  This  approach  is  based  on  the  rationale  that: 

1 .  Demonstrated  performances  can  at  least  be  sorted  according 
to  the  independent  measure  of  performance.  This  is  true  even  if  the  indep- 
dent  measure  is  a  terminal  one  that  indicates  the  value  of  the  performance 
only  at  weapons  launch,  and 

2.  Operator's  actions  which  produce  superior  results  can  be 
modeled  and  examined  to  show  how  superior  results  are  achieved. 

Thus,  the  method  is  designed  to: 

1 .  Identify  critical  ta  sks , 

2.  Identify  measures  of  performance, 

3.  Identify  control  techniques  associated  with  superior 
performance , 

4.  Establish  performance  criteria,  and 

5.  Establish  system  design  criteria. 

Three  types  of  models  are  used  to  represent  system  performance. 
As  shown  in  Figure  1 ,  the  three  models  are: 

1.  An  operator/pilot  operating  with  the  simulated  system, 

2.  Model  of  the  operator/pilot  operating  with  a  simulated 
system,  and 

3.  A  system  performance  model. 

Performance  demonstration  data,  such  as  flight  trajectories  and  values  of 
an  independent  performance  variable  (a  performance  score) ,  are  obtained 
from  model  1  (above).  In  the  F-106  attack  problem,  for  example,  the  terminal 
steering  error  and  error  rate  (at  missile  launcn)  are  used  as  the  independent 
performance  variables .  Performance  runs  are  divided  into  groups  according 
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SYSTEM  PERFORMANCE  MODEL 


to  the  independent  performance  variables.  Also,  the  problem  situation  space 
is  divided  into  regions  so  that  representative  pilot  control  policies  (model  2 
above)  for  each  performance  group  in  each  problem  situation  can  be  examined. 
Finally  a  performance  model  (3  above)  can  be  constructed  by  relating  pilot  control 
patterns  in  each  situation  to  the  independent  variable. 

The  F-106  attack  mission  simulation  has  three  phases: 

1.  Spotlight  (prelock- on) 

2.  Lock-on  (attempts) 

3.  Attack  (post  lock-on) 

In  the  spotlight  mode,  the  pilot  controls  the  aircraft  to  reduce  steering  error. 

In  the  lock-on  phase,  he  not  only  controls  the  aircraft  but  must  also  adjust 
his  antenna  azimuth  and  range  gate  controls  to  obtain  lock-on.  Finally,  in 
post  lock-on,  he  controls  steering  errors  and  pulls  the  arming  trigger  prior 
to  weapons  launch.  Each  of  the  three  phases  can  be  performed  with  greater 
than  20  seconds  to  missile  launch  (no  time  stress)  or  with  less  than  20 
seconds  (time  stress).  Thus,  there  are  six  problem  situations.  While  the 
pilot  controls  steering  error  as  a  primary  task,  analysis  of  the  performance 
demonstrations  shows  that  he  performs  this  task  in  a  different  way  in  each 
problem  situation.  The  performance  measurement  tool  described  in  this 
paper  utilizes  a  transition  matrix  representation  of  pilot  control  policy  and 
provides  a  means  for  (1)  identifying  those  portions  of  the  control  policy 
useful  in  performance  discrimination,  and  (2)  identifying  the  effects  of  secondary 
tasks  and  time  stress. 

Data  included  in  this  paper  are  extracted  from  the  final  report 
of  Contract  No.  F33615-73-C-4121  which  contains  a  more  complete  descrip¬ 
tion  of  the  experiment  and  results. 

PERFORMANCE  MEASUREMENT  DEVELOPMENT  METHOD 


Performance  Measure  System 

The  development  of  performance  measures  from  demonstration 
data  requires  a  systematic  means  for  processing  the  data  so  that  standard 
computerized  routines  can  be  used  to  develop  the  measures  and  to  support 
analysis  of  the  operator  control  policies.  While  a  standardized  process  is 
desirable,  each  different  type, of  operator  control  task  utilizes  different 
criterion  functions  and,  therefore,  require  different  types  of  measures. 

The  performance  measurement  development  method  described  here  accepts 
information  specific  to  the  problem  at  hand,  ^uch  as  recommended  criterion 
functions,  and  employs  a  standardized  processing  method  to  generate  the 
performance  measures. 
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Figure  2  is  a  block  diagram  of  the  system  used  to  process  the 
data.  The  problem  input  variables,  from  a  system  simulation,  are  directed 
to  a  set  of  Boolean  functions  which  ask  questions  about  the  variable  values. 
These  questions  are  selected  to  extract  information  believed  to  be  important 
to  performance  measurement  and  to  allow  convenient  analysis  of  the  input 
data.  For  example,  the  error  state  space  is  quantized  into  regions  end  the 
transition  patterns  from  one  region  to  another  are  examined  to  develop  the 
performance  metrics  required.  The  Boolean  variables  contain  two  types  of 
information: 


1 .  Information  extracted  from  the  input  variables,  and 

2.  Information  concerning  functions,  criteria  and  other 
data  believed  to  be  important  to  performance  measurement  in  this  particular 
problem. 

Since  the  inputs  to  the  Boolean  functions  are  functions  of  time,  the  outputs 
are  Boolean  time  sequences.  These  are: 

1 .  Boolean  variables  believed  to  be  related  to  performance,  and 

2.  Boolean  situation  variables  identifying  the  existence  of 
each  problem  situation. 

Problem  situation  variables  allow  consideration  of  each  situation  separately. 

For  instance,  in  the  problem  at  hand,  the  problem  situation  variables  identify 
prelock,  attempted  lock-on,  post  lock,  etc.,  so  that  performance  and  operator 
control  characteristics  in  each  situation  can  be  determined. 

As  shown  in  Figure  2 ,  pattern  detectdrs  are  used  to  extract 
information  on  patterns  which  are  likely  to  provide  good  performance  discrimina' 
tion.  Candidate  performance  measures  are  developed  from  these  patterns, 
compared  with  the  independent  performance  variable  and  adjusted,  ordered, 
selected  or  rejected,  based  on  the  degree  of  the  agreement  with  the  indepen¬ 
dent  performance  variable.  Once  agreement  is  obtained  between  the  predicted 
performance  variable  and  the  independent  performance  variable ,  the  perfor¬ 
mance  measurement  development  process  is  terminated  and  the  performance 
measurement  test  and  validation  process  is  initiated.  The  validation  process 
consists  of  two  steps. 

1 .  Introduce  problem  variables  from  new  data  into  the  system 
and  generate  predicted  performance  variables  which  are  compared  against 
the  independent  performance  variable  values.  No  adjustment  is  made  in  the 
performance  measure  function  when  testing  against  the  new  data . 
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2.  Examine  the  structure  of  the  performance  measures  which 
appear  to  have  validity  based  on  the  data  tests.  This  examination  is  required 
to  determine  what  factors  led  to  the  generation  of  effective  performance 
measures  and  evaluate  whether  these  are  "reasonable"  factors. 


Once  acceptable  performance  measures  have  been  developed, 
the  associated  transition  patterns  can  be  examined  to  determine  what  pilot 
control  factors  are  associated  with  superior  performance  and  not  associated 
with  less  than  superior  performance.  Also,  the  transition  patterns  are  examined 
to  determine  how  operator  performance  in  each  category  is  modified  under 
time  stress  and/or  secondary  problem  tasks. 

Transition  Analysis  Method 


As  shown  in  Figure  3,  one  set  of  Boolean  functions  divides 
the  steering  error  and  the  steering  error  rate  phase  plane  into  15  regions  or 
cells.  These  Boolean  functions  automatically  determine  the  present  location 
(cell)  of  the  demonstration  data,  which  facilitates  the  state  transition 
computation. 


Figure  3  Transition  States 

Several  matrices  are  used  in  the  transition  analysis  of  operator 
performance.  One  matrix  is  the  transition  matrix  which  is  a  15  x  15  matrix 
whose  elements  are  the  probabilities  of  transfer  from  cell  i  to  cell  J  on  a 
given  trial,  i.e  . ,  from  sample  to  sample.  This  matrix  is  constructed  by 
counting  the  number  of  times  the  svsiem  is  in  each  cell  and  makes  each 
transition.  If  the  resulting  transition  matrix  represents  a  regular  Markov 
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process,  the  state  of  the  system  after N  transitions,  starting  from  an  initial 
state  (cell)  distribution  represented  by  itq,  is  given  by 

*N  "  V"  (1) 2 3 

As  N  approaches  infinity,  there  is  a  limiting  distribution  a  given  by 
limit  n.r  =  a 

N  (2) 

N  *oo 


a  is  the  ensemble  state  distribution  existing  after  a  large  number  of  trials. 
The  limiting  distribution  can  be  regarded  as  the  steady  state  distribution, 
such  that 

aT  =  a  (3) 


A  second  matrix  useful  in  analysis  of  operator  control  policies 
by  transition  matrices  is  defined  by  Equation  4  and  is  the  weighted  transition 
matrix,  such  that  each  element  is  given  by: 


=  T  a 
ij  i 


(4) 


This  matrix,  referred  to  as  the  D  matrix,  is  obtained  by  multiplying  each  row 
of  the  transition  matrix  by  the  probability  the  ensemble  will  be  in  the 
corresponding  state.  The  elements  of  the  D  matrix  correspond  to  the  pro¬ 
babilities  that  a  particular  transition  (transtate)  is  used  in  a  given  control 
effort.  Elements  of  the  D  matrix  are  used  to  generate  a  performance  matrix 
according  to: 

P  =  SED  TSM  (5) 

i  |  3  1J 

where  TSM  is  a  transtate  score  matrix  whose  element  values  correspond 
to  the  relative  importance  of  each  transtate  to  performance. 


The  objective  of  applying  transition  analysis  to  model  operator 
control  policies  is  to  determine  how  the  superior  operators  achieve  superior 
results  and  to  derive  system  performance  measures.  Specific  questions 
of  interest  are: 

1 .  What  techniques  do  operators  use  in  providing  excellent 

control  ? 

2.  Are  the  control  policies  symmetrical? 

3.  Can  we  determine  where  performance  differences  occur 
in  the  state  space  ? 


4.  Can  we  determine  how  the  control  policy  changes  with 
different  problem  situations  within  a  performance  level? 

5.  Can  we  determine  policy  changes  or  policy  differences 
across  performance  levels ,  i.e. ,  how  do  control  policies  developed  by 

good  operators  (superior  operators)  differ  from  those  developed  by  intermediate 
or  poor  operators  in  the  same  problem  situation? 

6.  Do  the  trends  within  a  performance  level  apply  across 
performance  levels? 

PROBLEM  DESCRIPTION 


The  experimental  setup  consisted  of  an  operators  control  stick 
housing  the  radar  lock-on  controls,  and  a  display  system  interfaced  with  an 
IBM  360  coded  to  simulate  an  F-106  aircraft  in  a  co-planar  attack.  Aircraft 
heading  control  is  the  primary  task  and  the  operator's  input  for  this  task 
consists  of  lateral  motions  of  the  control  stick.  Radar  lock-on  tasks, 

(azimuth  and  range  gate  control)  provide  secondary  tasks.  The  essential 
elements  of  the  operator' s  display  are  shown  in  Figure  4 .  Roll  (0)  Is  the 
angle  between  the  wings  and  artifical  horizon.  Steering  error  is  displayed 
by  the  steering  circle  displacement  radius  from  the  display  center.  Radar 
azimuth  and  range  gate  position  are  also  indicated  on  the  display. 

The  pilot/operator's  flying  task  is  to  control  aircraft  roll  so 
that  the  steering  error  circle  moves  to  the  center  of  the  display  and  remains 
as  close  to  that  zero  steering  error  position  as  possible.  Radar  lock-on 
requires  two  operations,  adjusting  the  antenna  azimuth  so  it  is  pointing  to 
the  target  and  adjusting  the  range  gate  to  bracket  the  target.  Operator 
control  of  radar  lock-on  was  considered  as  a  secondary  task  and  lock-on 
performance  itself  was  not  measured. 

The  flying  task  can  be  described  with  the  aid  of  Figure  b. 

Roll  angle  and  steering  error  are  displayed  to  the  operator  and  he  attempts 
to  reduce  the  steering  error  by  adjusting  the  control  stick.  Roll  rate  is 
equal  to  a  constant  times  the  control  stick  position.  Automatic  turn  coordina¬ 
tion  is  assumed  and  thus  aircraft  turning  rate  is  a  TAN  function  of  roll  angle. 
The  difference  between  desired  heading  and  actual  is  the  aircraft  heading 
error,  0  ,  which  is  displayed.  Reference  heading  is  computed  using 

lead  pursuit  equations  so  that  the  pilot  is  not  required  to  lead  the  target 
but  instead  to  null  the  steering  error. 
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SIMULATOR  DISPLAY 


yyy?  v  W/  «  f 


Three  types  of  problems  were  presented  to  the  operators. 
Problem  A  allows  considerable  time  prior  to  lock-on  and  provides  the 
operator  an  opportunity  to  demonstrate  his  control  technique  without  time 
stress  and  secondary  tasks.  Problem  B  and  C  require  rapid  control  of  the 
aircraft  steering  error  and  radar  lock-on. 


SUMMARY  OF  EXPERIMENTAL  DATA 

The  terminal  scores  (heading  error  and  error  rate  at  missile  launch) 
for  each  of  the  87  demonstrations  are  plotted  In  Figure  6.  It  is  seen  that  all 
runs  for  operators  1  and  2  fall  within  the  region  from  0  to  X.  on  the  abscissa 
and  from  0  to  Y.  on  the  ordinate.  These  two  operators  consistently  achieve 
excellent  performance.  Another  region,  identified  as  the  area  between  and 
X«  on  the  abscissa  and  Yj  and  Y^  on  the  ordinate,  was  selected  to  include 
100%  of  the  runs  of  operator  4.  A  third  region  was  selected  to  include  a 
clustering  of  run  data  which  had  errors  less  than  30°  and  turning  rates  less 
than  3°  per  second,  as  indicated  by  bounds  X3,  Y3.  The  fourth  region  includes 
the  remaining  data .  All  demonstrated  performances  are  grouped  according  to 
the  region  in  which  the  terminal  performance  belongs,  i.e. ,  operator  identity 
was  not  used  to  group  demonstration  data. 

Typical  Trajectories 

Figures  7  through  12  are  plots  of  problem  trajectories  obtained 
from  simulator  data  which  show  (f>e  steering  error  versus  $  heading  rate.  It 
should  be  noted  that  the  aircraft  turning  rate  is  not  necessarily  the  same  as 
the  rate  of  change  of  steering  error  since  the  steering  error  is  not  necessarily 
constant  for  constant  aircraft  heading.  In  these  problems,  however,  the 
target  velocities  are  constant  and  thus,  the  computed  intercept  point  is 
constant.  As  a  result,  the  reference  heading  is  also  constant.  Figure  7 
shows  the  trajectory  of  run  111  during  the  spotlight  or  prelock-on  phase  of 
problem  A.  The  technique  used  by  operator  1  is  to  roll  the  aircraft  rapidly 
to  the  maximum  roll  angle  (75°)  and  subsequently,  when  the  steering  error 
is  approximately  10°,  he  rolls  the  aircraft  to  a  near  wings  level  attitude. 

This  produces  a  slight  overshoot  causing  approximately  a  4°  error.  The 
trajectory  occuring  during  lock-on  is  not  recorded  because  the  lock-on  takes 
only  a  few  seconds  and  the  lock-on  effort  does  not  induce  additional  errors. 
Figure  8  shows  the  post  lock-on  trajectory  for  the  same  run  on  a  different 
scale.  Note  that  the  post  lock-on  control  characteristic  yields  a  small 
oscillation  about  the  error  axis  with  a  rate  limit  of  approximately  +.  2°  per 
second  and  an  error  drift  from  +1  to  -  .2  degrees.  At  2°  error,  a  jump  occurs 
to  a  4.2°  error,  as  shown  by  the  dotted  line.  This  is  believed  to  be  a 


OPERATOR  SCORE  DATA 


FIGURE  6  OPERATOR  SCORE  DATA 


7  SPOTLIGHT  PHASE 
FOR  RUN  111 
(PROBLEM  T¥PE  A) 


discontinuity  in  the  simulator  and  occurred  at  an  unfortunate  time,  i.e. ,  lust 
prior  to  time  of  fire.  The  operator's  score  should  have  been  closer  to  -2° 
instead  of  -5°.  This  run  demonstrates  very  good  control  because  the  error 
was  reduced  rapidly  during  the  spotlight  phase,  little  steering  error  was 
introduced  during  the  radar  lock-on  phase,  and  a  small  error  and  small  error 
rate  was  maintained  during  the  attack  phase  (post  lock-on). 

Figure  9  presents  the  trajectories  produced  by  operator  1  on  his 
first  attempt  at  problem  B.  In  this  problem,  the  target  is  initially  within 
radar  lock-on  range  and  offset,  so  the  operator  must  make  a  sharp  turn  to 
obtain  lock-on.  Note  that  he  rolls  rapidly  to  the  roll  saturation  limit  of  75° 
but  rolls  out  late  at  approximately  2°  steering  error  which  produces  a  large 
overshoot.  In  spite  of  this  overshoot,  he  covers  nicely,  producing  an 
oscillatory  response  with  a  decreasing  steering  error.  Recall  that  problem 
B  has  initial  conditions  set  so  that  the  problem  is  initially  within  radar  lock- 
on  range.  The  technique  used  is  to  roll  to  a  75°  roll  angle  hard  limit  (the 
75°  hard  limit  is  built  into  the  simulation)  and  adjust  his  antenna  azimuth  and 
range  gate  to  obtain  lock-on  while  the  aircraft  is  against  that  hard  limit. 

This  technique  is  very  useful  in  the  simulator  but  unrealistic  since  the  air¬ 
craft  has  no  hard  limit. 

Figure  10  presents  the  trajectories  obtained  by  operator  1  on 
his  second  attempt  on  problem  B.  He  uses  essentially  the  same  control 
technique  and  achieves  the  same  result  as  he  did  on  his  first  trial. 

Trajectories  for  operator  1 1  s  first  and  second  attempts  on 
problem  C  are  given  in  Figure  11 .  Since  the  target  is  initially  within  radar 
lock-on  range,  the  operator  attempts  lock-on  almost  immediately  and  thus 
the  spotlight  phase  exists  for  only  a  few  seconds.  Figure  11  shows  trajec¬ 
tories  for  the  lock-on  phase  for  both  the  first  and  second  runs .  On  the  first 
run  the  pilot  is  able  to  achieve  lock-on  while  introducing  the  steering  error 
of  only  4°  and  requiring  only  3.5  seconds.  In  his  second  attempt  a  larger 
error  of  10°  is  introduced,  but  radar  lock-on  is  obtained  quickly  (3.0  seconds). 
Recovery  from  the  steering  errors  introduced  during  lock- on  is  shown  in 
Figure  12.  Both  trajectories  show  a  rapid  convergence  of  the  steering  error 
to  an  oscillatory  response  bounded  by  +4°  error  and  +4°/sec  error  rate.  These 
trajectories  are  typical  of  those  obtained  from  excellent  and  good  operators 
and  indicate  the  type  of  response  obtained. 


-296- 


ANALYSIS  OF  OPERATOR  CONTROL  POLICIEi 


The  transition  matrix  and  limiting  state  distribution  vector 
representing  each  performance  level  provide  information  on  how  superior 
operators  achieve  superior  performance  and  what  transitions  discriminate 
performance.  Characteristics  of  interest  include: 

1.  Probability  of  remaining  in  state  8  on  a  single  iteration, 
given  that  the  system  is  in  state  8.  Note,  state  8  is 
the  desired  terminal  cell,  as  shown  in  Figure  3. 

2.  Probability  of  transferring  to  state  8  on  a  single  iteration. 

3.  Probability  of  (an  ensemble)  being  in  state  8. 

4 .  Mean  number  of  iterations  required  to  return  to  state  8 
after  leaving  it. 

5.  Favored  entry  states  into  state  8. 

6.  Symmetry  of  important  transitions. 

For  the  F-106  attack  problem,  probabilities  representing  factors  1  and  3 
for  each  performance  level  and  problem  state  are  of  special  interest  and  are 
listed  in  Figuresl3  and  14  respectively.  Other  data  are  Included  in  the  pro¬ 
gram  final  report. 

Problem  situation  (PS)  0  exists  at  prelock-on-attempts  with 
greater  than  20  seconds  to  missile  launch  (no  time  stress).  Situations  2 
and  3  occur  when  the  pilot  is  attempting  lock-on,  with  situation  3  being 
under  time  stress  (20  seconds  to  go).  PS  4  and  5  are  post  lock-on  where 
accurate  steering  control  is  important  and  State  5  exists  when  the  problem 
has  less  than  20  seconds  to  go  (time  stress). 

Referring  to  Figure  1 3  is  seen  that  a  high  probability  (exceeding 
.90)  exists  for  performance  level  (PL)  1  subjects  in  problem  situations  0, 

4  and  5.  In  PS  2,  the  operator  is  attempting  lock-on  and,  as  a  result,  has 
a  lower  (.83)  probability  of  staying  in  state  8.  Note  that  no  data  is  available 
for  PL  1  performance  in  PS  3  because  in  no  case  were  skilled  operators  still 
attempting  lock-on  with  20  seconds  to  go.  This  means  that  superior  operators 
were  always  able  to  obtain  lock-on  prior  to  the  terminal  portion  of  the  mission. 
The  lower  probability  of  staying  in  state  8  while  attempting  lock-on  reflects 
the  influence  of  the  secondary  tasks  (radar  lock-on)  on  the  flying  performance. 
This  suggests  that  even  though  the  steering  error  was  small  and  the  wings 
were  near  level,  the  radar  lock-on  task  interfered  with  the  pilot's  ability  to 
fly  the  aircraft,  even  where  it  was  only  necessary  to  maintain  a  wings  level 
attitude. 
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A  similar  analysis  can  be  applied  to  the  probability  of  being 
in  state  8  (as  shown  in  Figure  14).  The  first  performance  category  shov/s 
a  0.49  probability  of  being  in  state  8  prior  to  lock-on  attempt,  a  0.0  pro¬ 
bability  of  being  in  state  8  during  lock-on,  and  0.72  and  0.71  probabilities 
of  being  in  post  lock-on  states  4  and  5  respectively.  The  0.49  probability 
associated  with  prelock-on  for  the  excellent  operators  indicates  that  the 
sequence  of  states  used  in  achieving  superior  performance  allows  approximately 
.5  probability  of  being  in  the  desired  state.  This  serves  as  a  norm  against 
which  other  performances  can  be  judged.  The  near  consistency  of  the  pro¬ 
bability  of  being  in  state  8  for  PS  4  and  5  show  that  good  operators  do  not 
allow  time  stress  to  significantly  degrade  their  performance. 

The  probabilities  of  remaining  in  state  8  (Figure  13),  given  that 
the  system  is  in  state  8  for  performance  levels  2,  3  and  4,  tend  to  be  in  the 
0.5-0. 6  range  until  after  lock-on  is  achieved.  During  post  lock-on  and 
prior  to  time  stress  (PS  4),  a  relatively  high  (0.8)  probability  of  remaining 
in  state  8  is  achieved;  however,  in  performance  categories  2  and  3  it  is 
seen  that  the  probability  of  remaining  in  state  8  drops  to  .  67  and  .  65  re¬ 
spectively  due  to  the  effect  of  time  stress.  The  corresponding  probabilities 
for  performance  category  4  are  surprisingly  high  and,  as  indicated  previously, 
possibly  reflect  that  some  operators  were  able  to  achieve  state  8  and  main¬ 
tain  it,  thus  producing  a  high  probability  of  staying  in  state  8.  However, 
upon  leaving  state  8,  they  were  unable  to  return  in  a  timely  manner  and, 
produced  a  low  score. 

The  entry  for  PS  3  for  PL  4  does  not  contain  any  data  because 
these  operators  never  achieved  state  8.  This  should  be  distinguished  from 
the  corresponding  lack  of  data  for  level  1  performance  where  the  superior 
operators  are  simply  not  attempting  lock-on  during  the  terminal  portion  of 
the  problem.  Thus,  the  poor  operators  in  PL  4  were  attempting  lock-on 
during  the  terminal  portion  of  the  problem  but  were  not  able  to  achieve  state 
8,  whereas  the  superior  operators ,  except  for  one  sample,  had  always 
achieved  lock-on  prior  to  that  time. 

The  effect  of  attempting  lock-on  is  also  indicated  clearly  by 
the  data  shown  in  Figure  14,  where  for  PS  3  we  have  near  zero  probabilities 
of  being  in  state  8  for  performance  levels  2 ,  3  and  4 .  This  indicates  a 
lack  of  accurate  aircraft  control  while  attempting  radar  lock-on.  Also,  post 
lock-on  without  time  stress  (Situation  4)  shows  a  marked  increase  in  the 
prooability  of  being  in  state  8.  However#  it  is  seen  that  there  is  a  significant 
reduction  in  that  probability  under  time  stress  (Situation  5). 
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As  expected,  the  ordering  of  the  probabilities  of  being  in 
state  8  are  in  complete  agreement  with  the  terminal  performance  metric 
(i.e. ,  the  steering  error  and  error  rate  at  missile  launch).  It  appears  that 
several  factors  affect  performance  of  manned  systems  and  of  these  the  ability 
to  maintain  stable  aircraft  control  and  properly  correct  for  small  errors  (i.e., 
remaining  in  the  desired  state  8)  are  of  critical  importance,  as  demonstrated 
by  the  data  in  Figure  H. 

PERFORMANCE  MEASURES 

The  performance  measurement  system  used  consists  of  two 

operations: 

1.  Training  the  performance  measurement  processor,  and 

2.  Producing  performance  measurement  scores. 

The  training  process  employs  a  search  of  the  transition  matrices  associated 
with  each  performance  level  to  find  the  importance  of  each  transition  (transtate) 
to  performance  measurement.  This  process  generates  a  transtate  score  matrix 
indicating  the  relative  significance  of  the  associated  transitions  to  perfor¬ 
mance  measurement.  Thus,  the  training  process  identifies  which  transitions 
are  consistently  employed  by  operators  providing  excellent  performance  and 
which  transitions  are  consistently  used  by  operators  with  other  levels  of 
performance.  The  numerical  value  of  each  element  of  the  transition  score 
matrix  is  adjusted  during  the  training  phase  based  on  the  independent  per¬ 
formance  variable.  Thus,  when  a  transition  score  matrix  is  produced  by 
the  training  phase,  a  performance  score  can  be  obtained  from  any  transition 
matrix  by  observing  the  value  of  each  transition.  For  example,  it  is  possible 
to  train  the  transition  score  matrix  based  on  the  flight  data  associated  with 
one  problem  situation,  say  initial  prelock-on  attempt,  where  the  operator 
is  not  time  stressed  nor  attempting  to  perform  a  secondary  task.  The  transi¬ 
tion  score  matrix  developed  from  this  data  can  be  applied  to  transition 
matrices  produced  by  any  problem  situation.  This  allows  evaluation  of 
performance,  i.e.,  control  policies,  in  one  problem  situation  based  on 
transition  ratings  developed  from  a  different  problem  situation.  Furthermore, 
comparison  of  transtate  score  matrices  developed  for  different  problem  situa¬ 
tions  can  be  compared  to  determine  how  differences  in  operator  flight  control 
problem  requirements  affect  the  way  performance  discrimination  can  be 
measured. 


Two  transtate  score  matrices  were  developed,  corresponding 
to  the  following  problem  situations: 
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1.  PS  0  (prelock-on  attempt,  no  time  stress),  and 

2.  PS  5  (post  lock-on,  time  stress). 

The  first  condition  is  one  in  which  the  operators  have  no  time  stress, 
i.e. ,  greater  than  20  seconds  to  go,  and  need  only  control  the  aircraft 
heading  since  they  are  not  attempting  radar  lock-on.  In  the  second  condi¬ 
tion  the  operator  is  under  time  stress. 

Figure  15  shows  the  score  for  each  PL  and  each  PS  produced 
by  a  transition  matrix  as  developed  from  Case  1 .  Since  the  score  matrix 
was  developed  based  on  PS  0,  it  is  not  surprising  that  the  performance 
scores  in  the  figure  for  that  situation  are  ordered,  the  highest  associated 

with  the  performance  level  (1).  Examining  the  scores  developed  for  the 
high  performance  category  (1),  it  is  seen  that  the  initial  high  score  (63) 
is  reduced  to  a  low  of  15  in  problem  situation  2,  i.e. ,  when  the  operator 
attempts  radar  lock-on.  A  relatively  high  performance  is  achieved  in 
problem  situation  4  (91)  followed  by  a  slight  reduction  in  the  score  in  the 
terminal  phase  when  the  operator  is  under  time  stress.  This  clearly  indicates 
that  operator  flight  control  performance  is  poor  while  attempting  radar  lock-on 
and  improves  in  post  lock-on,  but  degrades  slightly  with  a  time  stress. 

This  evaluation  is  based  on  factors  deemed  important  by  analysis  of  all 
performance  levels  in  PS  0  and  therefore  tends  to  emphasize  or  score  highly 
those  control  characteristics  related  to  aircraft  flight  performance  category 
without  time  stress.  Note  that  evaluation  of  each  performance  category  in 
the  final  problem  situation  (5)  is  not  ordered  by  this  metric  and,  indeed, 
performance  level  2  trials  are  rated  lower  than  level  4  trials  for  this  particular 
metric. 


Performance  evaluation  based  on  Case  2  is  shown  in  Figure  16. 
In  this  case,  we  see  that  the  values  associated  with  the  terminal  problem 
situation  (5)  are  well  ordered  in  accordance  with  the  independent  (terminal) 
performance  variable  (aircraft  steering  error  and  error  rate  at  missile  launch). 
Examination  of  the  first  column  of  the  matrix,  which  corresponds  to  the  per¬ 
formance  predictions  for  the  superior  performance  level,  indicates  the 
general  trend  of  problem  situations  that  was  observed  previously.  The 
values  of  the  first  row  of  the  figure  indicate  the  lack  of  monotonic  ordering 
in  that  the  second  level  group  is  rated  lower  than  that  of  the  third  and  fourth. 
This  evaluation,  of  course,  is  based  on  those  factors  deemed  important 
in  the  terminal  problem  phase  during  a  time  stress  situation.  It  suggests 
that  if  the  operators  of  the  second  category  had  used,  in  the  final  terminal 
situation, the  control  policy  demonstrated  in  the  first  problem  situation,  that 
group  would  of  been  rated  last.  It  is  of  interest,  therefore,  to  examine  the 
differences  in  transition  matrices  and  transition  score  matrices  that  would 
explain  the  performance  characteristics  shown  in  Figure  15  and  16. 
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The  transtate  score  matrix  elements  identify  which  transitions  are 
consistently  related  with  high  performance  and  which  transitions  are  con¬ 
sistently  related  to  low  performance .  These  are  the  transitions  that  ure 
used  to  discriminate  among  performance  levels.  Figure  17  shows  the 
transitions  associated  with  high  and  low  performance  for  Case  I  in  graphical 
form.  In  the  left  portion  of  the  figure,  the  solid  dots  and  solid  lines  indicate 
the  transitions  associated  with  score  values  of  75  to  100,  while  the  open 
circles  and  dotted  lines  represent  those  transitions  associated  with  incre¬ 
mental  score  values  of  51  through  74.  The  right  portion  of  the  figure  uses 
a  similar  coding  but  uses  the  solid  line  and  dot  representation  to  indicate 
low  scores  rather  than  high  scores.  It  is  seen  that  transitions  associated 
with  high  performance  tend  to  conform  with  the  slow  response  transitions. 

That  is,  slow  rate  of  change  of  error  seems  to  be  favored.  A  surprising 
factor  is  that  transitions  from  state  8  to  7,  3  and  9  are  used  to  identify 
Identify  high  performance  policies.  The  solid  dot  in  the  center  of  state 
8,  which  represents  the  "transition"  of  remaining  in  state  8,  is  associated 
with  a  high  performance  level  as  expected.  Transitions  associated  with 
low  performance  tend  to  move  the  system  towards  high  rates  of  change, 
that  is,  transitions  to  states  1,  2,  5,  11  and  12. 

A  companion  transition  diagram  for  Case  II  representing  states 
used  for  performance  discrimination  in  problem  situation  5  is  given  in 
Figure  18.  In  this  case  we  see  that  transitions  from  state  8  to  its  neighbors 
have  been  eliminated  as  a  criterion  for  identifying  high  performance.  In 
addition,  we  see  a  tendency  for  higher  rates  to  be  favored  by  the  high  per¬ 
formance  system.  Likewise,  we  see  that  low  performances  are  revealed 
by  transitions  from  state  8.  Thus  we  conclude  that  performance  discrimina¬ 
tion  under  stress  and  no  stress  require  a  different  set  of  measures. 

Several  transition  analyses  are  included  in  the  final  report  on  the  program 
but  were  not  included  here  for  briefness. 

Another  way  of  analyzing  operator  perfo.mance  is  based  on 
the  distribution  of  states  remaining  variant  under  a  single  transition.  As 
noted  previously,  if  the  transition  matrix  represents  a  regular  process,  the 
state  distribution  that  remains  invariant  under  a  single  transition  is  the 
limiting  distribution.  The  variant  distributions  for  performance  levels  1 
through  4  are  shown  in  Figures  19  through  22  respectively.  Referring  to 
Figure  19,  we  have  the  state  distributions  for  each  of  the  five  problem 
situations  analyzed.  The  first  situation  is  prelock-on  and  shows  there 
is  approximately  a  50  percent  probability  of  being  in  state  8  and  a  pro¬ 
bability  of  .1  or  less  for  the  remaining  states.  This  indicates  that  skilled 
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operators  are  able  to  move  through  the  sequence  of  states  leading  to 
state  8  and  remain  or  quickly  return  there.  This  control  characteristic 
contributes  to  the  high  probability  of  being  in  the  desired  state.  As  shown 
in  the  figure,  the  transition  characteristic  for  PS  2  yields  two  chains. 

One  chain  (A)  includes  states  1  through  10,  while  the  other  (B)  includes 
states  12  through  15.  These  are  absorbing  chains  with  an  absorbing  state 
(12)  in  chain  B,  so  that  once  state  12  is  reached  the  system  remains  there. 
This  reflects  a  case  of  limited  data  where  an  operator  moved  to  state  12 
while  attempting  lock-on  and  remained  there  during  lock-on,  which  occurred 
very  rapidly.  The  other  chain  transition  probabilities  yield  a  high  pro¬ 
bability  of  being  in  states  9  and  10  during  lock-on,  which  reflects  a  re¬ 
latively  low  error  drift  rate.  Only  one  sample  value  was  found  in  PS  3. 

That  is,  in  only  one  instance  did  any  one  of  the  superior  operators  attempt 
radar  lock-on  with  20  seconds  to  go  in  the  problem  period.  This  probably 
occurred  as  the  operator  was  attempting  lock-on  and  the  time  decreased 
to  20  seconds  to  go  Just  as  he  achieved  the  lock-on,  giving  us  only  one 
sample  in  that  problem  situation.  Thus,  that  particular  bar  chart  has  no 
significance. 

The  post  lock  conditions,  4  and  5,  indicate  a  high  probability 
of  being  in  the  desired  state  (8)  with  a  slight  degradation  in  performance 
under  time  stress,  as  indicated  by  the  diagram  for  situation  5. 

Performance  level  2  control  policies  are  illustrated  by  the 
invarient  distribution  characteristics  shown  in  Figure  20.  In  contrast  with 
the  performance  demonstrated  by  the  PL  1  operators ,  PL  2  operators  show 
no  definite  tendency  to  maintain  a  high  probability  of  being  in  state  8  in 
PS  0.  Instead,  there  is  a  uniform  probability  of  being  in  each  state  with 
voids  or  near  voids  in  states  5,  6,  10  and  11.  A  similar  situation  exists 
as  the  operator  attempts  lock-on  without  time  stress.  Performance  does 
not  seem  significantly  different,  perhaps  because  performance  was  not 
very  good  before  the  operator  attempted  radar  lock-on  and  therefore,  there 
is  little  room  for  degradation  of  performance  during  lock-on  attempts.  In 
problem  situation  3  (attempted  lock-on  with  time  stress),  the  process  is 
broken  into  two  chains,  one  consisting  of  state  4  and  the  other  comprising 
states  10  through  15.  However,  limited  data  in  this  problem  situation 
prohibits  meaningful  analysis.  Distributions  for  PS  4  and  5  show  that  the 
operators  in  this  classification  can  do  a  reasonably  good  job  in  maintaining 
control  of  the  aircraft  prior  to  time  stress  but  tend  to  deviate  from  state  8, 
moving  significantly  in  problem  situation  5.  Note  that  deviations  include 
states  3  and  13,  which  indicate  that  the  operators  are  trying  to  correct 
for  small  errors  with  large  roll  angles  and  thus,  are  moving  out  of  state 
8  with  large  error  rates.  This  is  a  common  problem  in  terminal  control 
tasks  where  the  operators  are  aware  of  time  limitations. 
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Figure  21  shows  the  distribution  of  states  for  PI  3  operators 
and  indicates  control  difficulty  in  problem  situations  0,  2  and  3.  In  these 
cases,  a  substantial  amount  of  data  is  available  for  radar  lock-on  attempts 
(situations  2  and  3)  since  the  operators  had  great  difficulty  in  achieving 
radar  lock-on  either  because  the  aircraft  was  not  maintained  in  a  suitable 
attitude  for  radar  lock-on  or  the  operators  were  not  skilled  in  adjusting 
antenna  azimuth  and  range  gate  control  in  order  to  obtain  radar  lock-on. 

As  a  result,  a  substantial  amount  of  time  was  devoted  to  attempting  lock-on  and 
these  operators  were  often  still  attempting  lock-on  in  the  terminal  problem 
phase.  This  control  policy  results  in  a  relatively  flat  distribution  in  state 
3,  as  shown  in  Figure  21 .  Post  lock  operations  show  that  the  operators 
can  maintain  a  high  probability  of  being  in  state  8  when  there  is  not  time 
stress  and  after  radar  lock-on  is  achieved.  However,  we  see  a  severe 
degradation  in  performance  with  time  stress  in  that  the  probability  of  being 
in  state  8  decreases  from  .8  to  approximately  .5  as  the  problem  moves  to 
the  terminal  phase. 

A  very  similar  situation  exists  with  the  PL  4  operators'  per¬ 
formance,  as  shown  in  Figure  22.  In  the  situation  4,  the  prot ability  of 
being  in  state  8  is  .60,but  the  control  policy  yields  a  wide  distribution  of 
other  states  including  1,  2,  3,  4,  7,  9,  13  and  14.  This  indicates  that 
when  the  system  leaves  state  8 ,  the  operators  have  difficulty  returning  in 
an  efficient  and  timely  manner  and  require  great  excursions  throughout  the 
state  space  in  order  to  attempt  to  bring  the  system  back  to  the  origin.  A 
significant  degradation  occurs  under  time  stress  for  PL  4  operators  where 
the  favorable  distribution  in  PS  4  is  completely  modified  and  the  system  now 
concentrates  in  states  2,  3,  4,  7,  8,  9,  12,  13,  and  14,  which  are  precisely 
those  states  required  to  represent  a  large  limit  cycle.  Thus  we  see  that  the 
level  4  operators'  performance  degenerates  into  a  large  limit  cycle  under 
time  stress. 


CONCLUSIONS  AND  RECOMMENDATIONS 


The  performance  measurement  tools  described  in  this  paper 
allow  analysis  of  operator  control  policy  in  each  performance  category  and 
problem  situation.  It  should  be  recognized  that  the  subject  operators  used 
in  this  study  were  not  skilled  F-106  pilots  and  thus,  conclusions  related  to 
performance  characteristics  may  not  reflect  skilled  pilot  control  characteristics. 

Conclusions  and  recommendations  from  this  study  include: 

1.  The  F-106  flight  control  problem,  as  presented  by  the 
F-106  simulator,  can  be  flown  reasonably  well  by  experienced  operators. 


However,  there  is  a  tendency  for  undershoots  caused  by  a  premature  roll 
to  wings  level.  Some  experienced  operators  use  an  overshoot  to  achieve 
a  rapid  response,  but  many  operators.  Including  those  less  experienced, 
tend  toward  the  undershoot  control  policy.  Operator  tendency  to  overshoot 
may  be  caused  by  the  non-linear  relationship  between  the  display  variables, 
steering  error  and  roll  angle.  This  display  should  be  modified  by  indicating 
the  non-linear  relationship  to  the  operator  or  by  modifying  the  display 
characteristics  to  remove  this  factor.  Following  the  modification,  the 
system  should  be  retested. 

3.  Operators',  flight  control  policies  tend  to  become  unstable 
when  radar  lock-on  is  attempted  and  when  time-to-go  is  less  than  20  seconds. 
Operator  flight  instability  when  attempting  lock-on  is  understandable  because 
the  operator  is  concentrating  on  a  task  other  than  flying.  It  should  be  noted, 
however,  that  antenna  azimuth  and  range  gate  controls  are  mounted  on  the 
flight  control  stick  and  any  motion  and/or  force  used  for  antenna  control 

may  affect  flight  control. 

4.  Time-to-go  of  less  than  20  seconds  is  indicated  by  a 
shrinking  circle  on  the  display.  Since  the  operator  tends  toward  unstable 
control  at  this  time,  the  value  of  that  display  function  is  questionable. 

5.  A  system  performance  measure  (performance  model)  is 
available  as  a  function  of  the  state  transitions  and  state  limiting  distributions. 
Valid  performance  measures  (i.e.,  those  that  discriminate  performance  levels) 
for  each  problem  situation  require  different  measure  functions.  Recognition 

of  this  difference  is  important  because  the  operator  control  criteria  is  dif¬ 
ferent  in  each  PS  and  as  a  result  performance  measurement  must  be  tailored 
to  each  task  criterion. 

6.  Skilled  operators  demonstrated  an  asymmetrical  control 
policy  producing  a  preference  for  approaching  the  origin  from  one  direction; 
however,  the  experiment  was  not  designed  to  test  for  this  policy  characteristic. 
Additional  experiments  are  required  to  ascertain  if  the  asymmetrical  control 
pdlicy  is  typical  of  skilled  pilots.  It  is  important  to  determine  if  this  policy 

is  commonly  used  by  skilled  pilots  since  that  fact  could  be  exploited  in  air 
combat. 
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ABSTRACT 


v* 


The  sensation  of  self-motion  based  on  rotating  visual  fields 
was  investigated  in  the  pitch,  roll  and  yaw  axes  using  large  visual  K 
field  motion  in  a  high  performance  aircraft  simulator.  The  devel¬ 
opment  of  roll  tilt  angle  and  steady  state  yaw  velocity,  for 
constant  speed  roll  and  yaw  stimuli  respectively,  were  consistent 
with  earlier  reports.  Steady  pitch  offset  was  also  discovered, 
increasing  with  pitching  field  velocity  up  to  40  deg/second.  The  ^ 

induced  pitch  angle  was  markedly  stronger  in  the  forward  than  in  fc 

the  backward  sense. 

Pitch  and  roll  effects  were  found  to  depend  strongly  on  head 
position.  The  tilt  magnitudes  were  increased  for  the  head  90°  to 
the  side,  and  for  the  head  inverted,  but  were  decreased  for  the  ^ 

head  pitched  25°  forward.  These  results  support  a  hypothesis  that 
the  visually  induced  tilt  is  limited  by  conflict  with  otolith  infor-  > 
mation,  which  fails  to  confirm  this  tilt.  They  are  consistent  with 
the  observations  by  other  investigators  that  uncertainty  in  orien¬ 
tation  based  on  graviceptor  cues  increases  as  the  major  utricular 
plane  is  tilted  out  of  the  horizontal. 

fei 

Peripheral  field  stimulation  was  shown  to  be  the  adequate 
stimulus  for  the  self-motion  rotation  about  all  three  axes.  The 
upper  visual  field  was  found  to  be  dominant  in  the  generation  of 
pitch  sensation.  Any  moving  visual  scene  containing  sufficient 
moving  visual  borders,  including  a  realistic  picture  of  the 
earth  (but  not  the  blank  sky) ,  was  able  to  generate  the  self  motion. 


*This  work  was  supported  under  NASA  Grant  NGR  22-009-701. 


£ 


-319- 


The  sensation  of  self-motion  created  by  moving  visual 
scenes  was  known  for  many  years  (Mach,  1973;  Fischer  and 
Kornmttller,  1930) .  It  is  used  in  flight  simulators  (Miller 
and  Goodson,  1960)  and  for  amusement,  and  has  recently  been 
associated  with  vestibular  stimulation.  The  vestibular 
t^e  appears  in  both  psychophysical  and  neurophysiological 
investigations.  The  association  also  bears  on  the  etiology 
of  motion  sickness  (Graybiel  and  Miller,  1968;  Johnson,  1968; 
Money,  1970) .  The  development  of  self  rotation  or  circular- 
vection  (CV)  about  the  longitudinal  (yaw)  axis  influences 
the  perception  of  true  body  acceleration  (Young  et  al,  1973) . 
The  influence  of  moving  visual  fields  has  been  seen  in  single 
unit  recordings  in  the  vestibular  nerve  of  goldfish  (Klinke 
and  Schmidt,  1970)  and  the  vestibular  nucleus  of  goldfish 
(Dichgans  et  al,  1973)  and  monkeys  (Henn  et  al,  1974) .  Self 
motion  effects  have  been  studied  in  yaw,  lateral  tilt  (Dich¬ 
gans  et  al,  1972),  and  in  linear  motion  (Pavard  et  al,  1974). 
The  goal  of  the  present  study  was  to  investigate  the  parameters 
of  the  adequate  visual  stimulation  for  pitch  as  well  as  for 
roll  and  yaw  effects,  and  to  test  a  theory  of  visual-vestibular 
interactions  by  assessing  the  influence  of  different  head 
orientations  on  the  visual  effect.  In  particular,  the  theory 
holds  that  the  extent  of  tilt  of  the  apparent  vertical  based 
on  visual  cues,  including  moving  scenes,  is  limited  by  conflict 
with  information  from' the  otoliths.  As  will  be  shown,  head 
orientations  away  from  the  erect  position  place  the  utricular 
graviceptors  in  relatively  less  sensitive  positions,  which 
are  consequently  less  effective  in  inhibiting  the  visual  tilt 
illusion. 

All  of  the  principal  experiments  were  carried  out  in  one 
of  the  differential  maneuvering  simulators  (DMS)  at  the  NASA 
Langley  Research  Center*.  Each  simulator  consists  of  a  jet 
cockpit  mounted  on  a  platform  inside  a  forty  foot  diameter 
projection  sphere.  In  the  present  experiments,  one  subject 
sat  in  the  cockpit,  and  the  remaining  subjects  stood  beside 
the  cockpit  at  the  edge  of  the  platform.  All  were  afforded  a 
complete  full  field  view  of  the  sphere  wall  in  the  direction 
they  were  facing,  with  the  exception  of  the  subject  in  the 
cockpit,  who  had  only  an  upper  field  view. 

Visual  scenes  were  projected  on  the  interior  of  the 
sphere  wall  by  a  computer  controlled  projection  system.  This 
consisted  of  two  servo-driven  transparent  plastic  hemispheres 

*  Mr.  Ralph  Stone  of  NASA  coordinated  the  experimental  facility 
at  Langley  and  arranged  for  our  experiments.  We  are  grateful 
to  the  NASA  personnel,  especially  Mr.  Billy  Ashworth  for 
coordinating  the  programming  and  simulator  operation,  and  to 
Dr.  C.  Ormsby  and  Professor  R.  Curry  of  M.I.T. 


on  which  the  scenes  to  be  projected  were  painted.  A  high 
intensity  point  light  source  mounted  near  the  center  of  each 
hemisphere  projected  the  scene  onto  the  interior  walls  of  the 
simulator  sphere.  The  standard  hemispheres  used  in  these 
experiments  projected  a  pattern  of  464  randomly  spaced  and 
oriented  black  rectangles,  2-3°  in  subtended  angle,  against 
a  white  background.  The  black-white  ratio  was  approximately 
25%.  For  certain  experiments,  a  realistic,  colored  earth-sky 
globe,  and  a  black-white  latitude-longitude  globe  were  used. 

A  minimum  of  four  subjects  participated  in  each  experi¬ 
ment.  The  cockpit  subject  indicated  his  perception  of  the 
vertical  and  of  yaw  rate  with  instruments  provided  for  this 
purpose.  All  subjects  reported  their  subjective  sensations 
of  rotation  (circular vect ion,  CV) ,  tilt  and  linear  motion 
( 1 inear vect ion,  LV)  quantitatively  on  reporting  forms.  All 
subjects  were  previously  trained  to  report  angular  velocity 
and  tilt  consistently. 

Experiment  1:  Yaw  Circularvection 

Method 


A  series  of  constant  velocity  yaw  stimuli  were  presented 
randomly  left  and  right  at  speeds  of  5,  10,  20,  40,  60  and 
120  degrees/second.  Subjects  reported  CV  strength  in  deg/sec, 
and  latency  to  onset,  using  a  stopwatch.  Subjects  were  aware 
of  the  speeds  available. 

Results 


The  circularvection  generally  increased  monotonically 
with  field  velocity,  but  was  usually  not  saturated  (the  pattern 
did  not  appear  stationary  in  space  during  perceived  steady 
state  self  rotation) .  The  latencies  to  onset  of  CV  decreased 
with  increasing  field  speed,  as  shown  in  Figure  1. 

Discussion 


The  rapid  decrease  in  time  to  onset  of  CV  with  increasing 
pattern  speed  is  consistent  with,  but  much  more  marked  than 
that  reported  by  Brandt  et  al  (1973).  The  use  of  the  lowest 
test  speed,  5  deg/sec,  in  the  current  experiments  makes  the 
trend  clearer  than  in  the  earlier  experiments.  The  fact  that 
the  time  to  onset  of  CV  decreases  witn  field  speed,  whereas 
the  time  to  steady  state,  as  reported  by  Brandt  et  al,  in¬ 
creases  with  stimulus  speed,  requires  further  investigation 
in  light  of  the  interpretation  of  latencies  based  on  resolution 
of  the  visual  vestibular  conflict. 


Experiment  2: 


Apparent  Tilt  in  Pitch  and  Roll  for  various 
Head  Positions 


Method 


The  method  for  presenting  rotating  visual  fields  in  the 
pitch  and  roll  plane  was  the  same  as  for  yaw.  Velocities  of 
I  5,  10 ,  20 ,  40 ,  and  60  deg/sec  were  presented  randomly  for 
40  seconds  with  a  pause  of  20  seconds  between  tests.  The 
subjects  were  tested  with  their  head  in  four  positions:  head 
erectf  head  forward,  head  tilted  right  ear  down,  and  head 
inverted.  Head  erect  is  the  normal  upright  position.  In  head 
forward  position,  the  head  was  nodded  25°  forward  so  as  to 
put  the  dominant  plane  of  the  utricular  otoliths  in  the  earth 
horizontal  plane.  This  head  position  was  achieved  approximately 
by  instructing  the  subject  to  place  a  line  between  the  external 
auditory  meatus  and  the  upper  margin  of  the  bony  orbit  in  a 
horizontal  plane.  The  head  tilted  right  ear  down  position  was 
intended  to  place  a  lateral  axis  of  the  head  in  a  vertical 
plane.  Subjects  used  the  railing  of  the  simulator  platform 
for  assistance  as  a  convenient  vertical  reference  in  setting 
head  position.  For  the  head  inverted  experiments,  subjects 
placed  themselves  supine  on  the  platform  with  their  head  leaning 
backward  over  the  edge  of  the  platform.  In  reporting  on  sub¬ 
jective  pitch  and  roll,  all  reports  were  referenced  to  the 
platform  axis.  For  example,  a  subject  viewing  this  in  a  head 
inverted  position  so  that  the  visual  field  was  moving  toward 
the  top  of  his  head,  would  feel  that  he  was  pitching  upward 
in  this  platform  coordinate  system.  All  pitching  and  rolling 
effects  were  much  stronger  for  subjects  positioned  in  the 
cockpit  at  the  center  of  the  sphere  than  for  those  standing 
on  the  platform.  Therefore,  for  analysis  of  effects  of 
different  head  positions  on  visually  induced  tilts,  only 
those  two  subjects  are  considered  who  stood  on  the  platform 
for  all  four  head  positions  in  pitch  and  roll. 

Results 


Figure  2  shows  the  reported  steady  state  roll  angle 
for  each  subject  at  each  speed  of  roll  stimulation  with  the 
visual  field  rolling  to  the  right  and  to  the  left.  Rotation 
of  the  visual  field  to  the  right  as  seen  by  the  subject  (clock 
wise)  results  in  a  steady  state  perception  of  subjective  tilt 
to  the  left  (roll  left) .  For  the  head  erect,  the  median  tilt 
as  well  as  that  for  each  subject,  showed  the  characteristic 
increase  of  apparent  tilt  with  field  speed  up  to  a  maximum 
level  generally  in  the  region  of  40  deg/sec,  although  some 
subjects  showed  maximum  response  at  60  deg/sec.  (By  way  of 
comparison,  the  tilt  angle  versus  field  speed  used  in  the 
partial  field  experiment  reported  by  Dichgans  et  al  is  also 
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shown  in  figure  2b  and  is  seen  to  produce  a  lesser  degree 
of  induced  tilt.}  The  four  conditions  of  different  head 
position  are  shown  in  figures  2a,  b,  c,  and  d,  arranged  in 
the  order  of  predicted  increase  in  subjective  tilt.  Note 
that  in  the  head  25°  forward  position,  the  apparent  tilt 
was  reduced  relative  to  the  head  erect.  In  contrast,  as 
the  head  is  moved  to  the  right  shoulder,  the  strength  of 
the  tilt  illusion  increases  markedly  at  all  speeds.  Tilt 
angle  was  still  greater  in  the  head  inverted  position. 

Most  cases  of  roll  apparent  tilt  were  also  accompanied 
by  a  sensation  of  linear  translation  (linearvection)  to  the 
left  or  right,  except  when  the  subject  was  positioned  on  the 
axis  of  rotation  in  the  cockpit.  In  each  case,  the  linear 
motion  sensation  could  be  attributed  to  the  subject's  head 
position  away  from  the  axis  of  rotation  of  the  field. 

A  similar  presentation  of  induced  pitch  angle  for  a 
visual  pitching  stimulus  is  shown  in  figures  3a-d.  Figure 
3b,  for  the  head  erect  position,  demonstrates  that  a  pitch 
illusion  similar  to  that  found  for  the  roll  case  is  indeed 
present.  The  illusion  of  pitching  increases  with  the  speed 
of  field  rotation  up  to  a  plateau  in  the  region  of  40  deg/sec 
for  the  field  moving  down  (pitch  up) .  The  most  obvious 
difference  between  the  pitch  and  roll  situations  is  the 
presence  of  a  marked  asymmetry  in  pitch.  All  subjects  ex¬ 
perienced  a  much  stronger  sensation  of  pitching  down  than  of 
pitching  up  for  symmetric  visual  stimuli.  Another  important 
difference  between  the  pitch  and  roll  sensation  is  the 
presence  of  a  substantial  amount  of  linearvection  in  the 
vertical  direction  for  pure  pitch  stimuli.  The  visual  field 
pitching  down  resulted  in  a  sensation  of  constant  velocity 
vertical  translation  upward  as  well  as  pitch  up,  and  conversely 
for  the  visual  field  moving  upward. 

Returning  to  figure  3a  (the  head  forward  position)  one 
sees  a  marked  reduction  in  the  pitch  sensation  both  for  field 
pitching  up  and  for  field  pitching  down.  The  pitch  sensation 
was  almost  entirely  replaced  by  a  sensation  of  pure  linear¬ 
vection  in  the  upward  or  downward  direction.  As  the  head  is 
tilted  to  right  ear  down  position  (figure  3c)  the  pitch  sensa¬ 
tion  was  increased  relative  to  the  head  erect  orientation. 
Finally,  with  the  head  in  the  inverted  position,  as  seen  in 
figure  3d,  the  magnitude  of  the  pitch  sensation  was  very  markedly 
increased,  resulting  in  subjective  pitch  of  greater  than  90° 
on  occasion.  It  is  also  to  be  noted  that  in  the  head  inverted 
position,  the  sensation  of  pitching  up  was  much  stronger  than 
the  sensation  of  pitching  down.  However  recalling  that  pitch 
is  indicated  in  "platform  coordinates",  one  sees  that  the 
direction  of  the  asymmetry  in  pitch  remains  the  same  with 
respect  to  the  body  (figure  3b);  i.e.  the  induced  sensation  of 
tumbling  forward  was  stronger  than  that  of  tumbling  backward. 
Notice  that  the  asymmetry  does  not  entirely  disappear  for  the 
case  of  the  head  on  the  right  shoulder,  where  the  visual  stimu¬ 
lus  for  pitching  up  and  down  is  symmetric. 


To  compare  the  effects  of  head  position  on  pitch  and 
roll  tilt  quantitatively,  linear  regression  lines  were  calcu¬ 
lated  for  those  two  subjects  who  completed  all  test  conditions 
on  the  platform.  These  regression  lines,  representing  the 
strength  of  the  visually  induced  tilt,  passed  through  the 
origin  and  formed  a  least  mean  squares  fit  to  the  induced  tilt 
angles  at  10,  20,  and  40  deg/sec  stimulation.  Separate  lines 
were  calculated  for  each  direction  of  stimulation.  Figure  4 
shows  the  slope  of  the  regression  line  for  roll  tilt  in  the 
0  to  40  deg/sec  stimulus  range  for  the  four  head  positions 
considered.  Pitching  the  head  forward  by  25°  inhibited  the 
strength  of  the  induced  tilt  illusion  by  about  35%,  whereas 
tilting  the  head  to  the  right  shoulder  increased  the  strength 
of  the  illusion  by  approximately  35%. 

The  regression  line  slopes  for  the  same  two  subjects 
for  the  pitch  experiments  are  given  in  figure  5.  For  the 
head  erect  position  the  illusion  of  pitching  down  had  an 
index  40%  greater  than  that  for  pitching  up.  When  the  head 
was  tilted  25°  forward  the  asymmetry  remained,  but  the  strength 
of  the  apparent  pitch  was  greatly  reduced.  Tilting  the  head 
90°  to  the  right  increased  the  sensitivity  of  pitch  illusion 
somewhat  compared  to  the  head  erect  position,  while  retaining 
the  earlier  asymmetry,  in  body  axes,,  but  not  in  head  axes. 

For  the  head  in  the  inverted  position,  the  strength  of  the 
pitching  response  was  enormously  increased  and  the  direction 
of  the  asymmetry  in  simulator  axes  is  reversed. 

Discussion 


The  experimental  evidence  summarized  in  figures  4  and 
5  supports  the  hypothesis  that  the  strength  of  the  pitching 
and  rolling  illusions  depends  on  head  orientation  with  respect 
to  the  vertical. 

For  cases  of  continuous  circularvection  about  a  vertical 
axis,  the  otoliths  play  no  apparent  part  in  confirming  or 
denying  the  visually  induced  sensation  of  continuous  motion, 
since  no  change  in  orientation  with  respect  to  the  vertical 
is  implied.  When  the  visually  induced  sensation  is  such  as 
to  produce  a  change  in  orientation  with  respect  to  the  verti¬ 
cal,  however,  the  subject  would  normally  expect  to  receive 
otolith  signals  confirming  this  change  in  position.  The 
fact  that  the  head  actually  remains  fixed  in  each  of  these 
experiments,  and  that  such  confirming  otolith  information 
is  not  forthcoming,  may  be  thought  of  as  creating  a  sensory 
conflict  which  limits  the  extent  of  the  visually  induced 
sensation  (Guedry,  1968).  Other  indirect  evidence  (e.g. 

Schftne  and  Udo  de  Haes,  1968?  Udo  de  Haes  and  Schttne,  1970? 
Benson,  1974?  Guedry,  1968?  Graybiel  and  Clark,  1962)  for 
example  supports  the  notion  that  otolith  effectiveness  in 
surpressing  orientation  information  from  other  sensors  is 
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maximum  in  the  head  erect  position  and  minimized  when  the 
head  is  tilted  to  the  side  (Young,  1971) .  Although  the 
fact  is  well  established  that  graviceptor  information,  used 
to  indicate  perceived  orientation,  displays  increasing 
systematic  and  random  errors  with  head  tilt,  the  explanation 
is  not  certain.  It  is  possible  that  a  central  pattern  recog¬ 
nition  system  processing  the  wide  range  of  otolith  and  other 
graviceptor  afferents  is  tuned  to  operate  in  the  most  common 
position  for  postural  control  of  the  standing,  head  erect  man. 
Alternatively,  the  explanation  could  be  based  in  large  part 
on  the  mechanical  processes  in  the  labyrinth'.  This  working 
hypothesis  assumes  that  the  utricular  otolith  is  primarily 
responsible  for  the  sensation  of  head  tilt,  and  that  the 
shear  component  of  gravity  is  the  adequate  stimulus.*  (Accel¬ 
erations  normal  to  the  utricular  plane  lead  to  frequent  mis¬ 
judgements  of  direction  (Malcolm  and  Melvill  Jones,  1974; 
Melvill  Jones  and  Young,  1974) ) .  The  head  orientation  for 
"best  sensitivity"  of  the  utricular  otolith,  and  thus  maximal 
inhibition  of  visually  induced  pitch  and  roll,  should  be 


*The  components  of  gravity  along  the  axes  directed  forward  along 
the  “utricular  plane"  (x) ,  laterally  to  the  left  in  this  plane 
(y) ,  and  normal  to  the  plane,  pointing  upward,  (z)  ares 

f  =  cosy  sin0  -  siny  cos<J>  cos  9 
f*  «  -sinij)  cos0 

fy  »  -siny  sin0  -  cosy  cos<ji  cos0 

Z 

where  y  *  angle  of  elevation  of  the  utricular  plane  with  respect 
to  the  head  lateral  plane  (approx.  25“ 1 
0  *=  pitch  angle  of  the  head  about  the  horizontal  axis 
(positive  for  pitch  down) 

<t>  *  lateral  tilt  of  the  head  about  the  head  forward  axis 
(positive  for  roll  right  ear  down) . 

0  and  $  are  Euler  angles .  A  given  head  orientation  is  defined  by 
a  rotation  in  0  followed  by  one  in 

The  sensitivity  to  pitch  is  given  by 

cosy  cos0  +  siny  cos<J>  sin0 

and  for  the  special  case  of  <J>  =  0,  it  simplifies  to 

cos  (0  -  y) 

which  is  maximized  for  the  head  pitched  forward  by  y.  Pitch 
sensitivity  is  90%  of  maximum  for  the  head  erect. 

For  roll  about  an  earth  horizontal  axis  (rather  than  the  head 
forward  axis)  the  roll  sensitivity  is 

cos(0  -  y)  cos$ 

which  is  also  maximized  for  the  head  pitched  y  degrees  forward, 
and  decreases  to  a  minimum  for  the  head  rolled  90  degrees  to  the 
right  or  left. 


with  the  head  pitched  25°  forward  from  the  normal  head  erect 
position.  This  position  places  the  dominant  plane  of  the 
utricular  maculae  in  the  horizontal  plane  and  maximizes  the 
change  in  gravitational  component  in  this  plane  resulting 
from  head  movements.  Tilting  the  head  to  the  right  90° 
should  place  the  utricular  plane  vertical/  and  make  the 
utricular  otoliths  minimally  sensitive  to  changes  in  body 
position.  As  is  well  known  from  psychophysical  studies, 
the  utility  of  statolith  information  with  the  head  inverted 
is  also  poor.  (The  shear  sensitivity  model  alone  does 
not  account  for  this  fact.  Additional  assumptions  concerning 
the  ambiguity  of  sacc’ilus  information  may  be  of  help  in 
interpretation  (Ormsby,  1974)).  The  data  for  both  pitch  and 
roll  supported  the  hypothesis  that  the  otolith  information 
is  used  to  limit  the  magnitude  of  tilt  based  upon  visual 
input,  and  that  the  effectiveness  of  this  otolith  information 
decreases  in  a  predictable  fashion  as  the  head  is  moved 
away  from  its  maximal  sensitivity  orientation  of  25°  pitched 
forward. 

The  observation  that  the  direction  of  the  pitch  asymmetry 
remains  fixed  in  body  axis  eliminates  the  possibility  that 
it  is  associated  with  the  direction  of  "down" .  Retinal  or 
utricular  directional  asymmetries  might  be  considered  as  the 
source,  however.  The  results  of  experiment  4  support  a 
visual  origin  of  the  pitch  asymmetry.  All  speculation  is 
complicated  by  the  observation  that  this  asymmetry  seems  to 
remain  even  with  the  head  tilted  90°  to  the  right,  so  that 
the  visual  field  motion  is  in  the  head  lateral  plane.  One 
possibility  is  that  the  coordinate  system  of  importance  is 
that  of  body  axes  (rather  than  head  axes)  since  a  principal 
role  of  visual  and  vestibular  motion  sensing  is  postural 
stabilization  of  the  body,  even  with  the  head  bent. 

It  might  be  argued  that  the  usually  induced  tilt  effects 
for  the  head  tilted  experiments  could  have  been  confounded 
by  the  Aubert  or  Mflller  effects  of  errors  in  tilt  estimation 
with  varying  head  positions.  The  non-visual  orientation 
estimations  were,  in  fact,  measured  for  all  subjects  later, 
and  were  all  A-effects  (underestimation)  of  15  to  30°  for 
the  head  tilted  right  and  left  ear  down.  For  the  experiments 
under  discussion,  however,  all  indications  of  apparent  tilt 
were  made  relative  to  an  initial  subjective  orientation 
judged  with  tilted  head  and  no  moving  visual  scene.  The 
present  data  therefore,  concerns  the  visually  induced  tilt 
effects  alone.  Dichgans  et  al  (1974)  explore  the  relationship 
between  subjective  tilt  based  on  head  tilt  and  rotating  visual 
field. 


Experiment  3:  Effects  of  Visual  Field  Placement  on  Induced 
Tilt 


Method 


A  variety  of  masks  were  used  in  the  pitch  and  roll 
experiments  to  determine  the  effects  of  different  portions 
of  the  visual  field  upon  the  tilt  effect.  Brandt  et  al 
(1973)  showed  that  the  peripheral  visual  field  is  dominant 
in  producing  yaw  circularvectionf  and  Held  et  al  (1974) 
demonstrated  the  increasing  importance  of  peripheral  field 
stimulation  on  the  induced  tilt  in  rollf  showing  sensitivity 
to  stimuli  increasing  with  angular  distance  from  the  fovea. 
Whereas  those  investigations  explored  principally  the  radial 
characteristics  of  the  visual  field,  the  current  experiments 
investigated  the  differential  effects  of  the  upper  and  lower 
visual  field  in  an  attempt  to  discover  a  relationship  to  the 
asymmetry  in  the  pitching  response  previously  discussed.  The 
experiment  consisted  of  four  test  fields.  All  tests  were 
performed  with  the  head  erect  and  the  pitch  and  roll  stim¬ 
ulation  presented  at  i  5,  10,  20,  40  and  60°/second.  The 
control  was  the  full  field  stimulus  of  experiments  1  and  2. 
The  peripheral  stimulus  was  obtained  by  use  of  a  hand  held 
cardboard  mask  blocking  the  central  60  degrees  of  the  field. 
The  upper  visual  field  and  the  lower  visual  field  stimuli 
were  achieved  by  having  each  subject  block  his  lower  or 
upper  field  with  a  cardboard  mask  held  at  eye  level. 

Results 


No  obvious  difference  in  the  roll  tilt  effect  is  seen 
among  the  various  conditions.  For  the  two  subjects  completing 
all  tests  standing  on  the  platform,  the  0  -  40°/sec  regression 
line  slopes  calculated  as  described  earlier  and  shown  in 
figure  6  showed  no  evident  changes  in  sensitivity  among 
these  conditions. 

The  effect  of  visual  field  placement  on  the  pitch  sen¬ 
sation,  however,  was  strikingly  different.  A  dimunition  of 
the  size  of  the  visual  field  decreased  the  strength  of  the 
pitch  sensation.  In  figure  7a,  for  the  case  where  the  sub¬ 
jects  could  see  the  lower  visual  field  only,  all  subjects 
standing  on  the  platform  had  a  marked  reduction  of  pitch 
sensation  in  both  directions  relative  to  the  full  field.  This 
field  consistently  produced  strong  vertical  linearvection. 
When  the  upper  field  only  was  exposed,  a  stronger  sensation 
of  pitching  down  thah  of  pitching  up  was  evident,  although 
neither  was  of  the  strength  seen  for  the  full  field  (figure 
7b).  With  the  peripheral  field  only  exposed  (figure  7c)  the 
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pitch  sensation  was  slightly  reduced  compared  to  that 
for  the  full  field.  The  regression  line  slopes  for 
the  two  subjects  completing  all  visual  field  tests 
on  the  platform  are  given  in  figure  8.  Notice 
that  the  marked  pitch  down  dominance  is  present  for 
the  full  field  and  even  more  so  for  the  upper  field 
only,  but  disappeared  for  the  lower  field  only,  where 
pitching  up  and  down  are  both  reduced. 


Discussion 


The  fact  that  blanking  the  central  60  degrees  of 
the  visual  field  does  not  greatly  reduce  the  pitch 
or  roll  effect  is  consistent  with  earlier  results 
demonstrating  the  importance  of  peripheral  stimulation 
for  this  effect.  The  differing  effect  of  the 
upper  and  lower  visual  fields  on  subjective  pitch  is 
not  as  readily  explainable.  A  possible  explanation 
lies  in  the  differences  in  the  natural  whole  field 
motion  normally  seen,  and  its  relation  to  different 
body  movements.  The  lower  visual  field,  below 
the  horizon  for  the  head  erect,  contains  many  near 
objects,  some  as  close  as  the  ground  below  one's 
feet.  These  objects  all  move  downward  in  the  visual 
field  during  forward  locomotion,  at  an  angular  velocity 
inversely  proportional  to  distance.  Whole  field 
motion  downward  in  the  lower  field  is  therefore 
often  correctly  associated  with  linearvection.  The 
upper  visual  field,  more  often  contains  objects  at 
great  distance;  clouds  or  tall  buildings,  for 
example.  Distant  objects  would  not  all  move  in  the 
visual  field  during  one's  translatory  motion,  but 
they  would  during  angular  changes  such  as  pitch  and 
roll.  It  is  therefore  plausible  that  motion  of  the 
upper  field  only  would  lead  to  primarily  a  pitch 
sensation,  whereas  motion  of  the  lower  visual  field 
primarily  induces  linearvection  only.  Furthermore, 
when  falling  forward  from  an  erect  position,  the 
horizon  line  moves  into  the  upper  visual  field, 
whereas  it  moves  into  the  lower  visual  field  for  a 
backward  fall.  Following  this  line  of  reasoning, 
then,  it  is  conceivable  that  the  upper  visual  field 
is  dominant  in  the  determination  of  forward  pitch, 
and  conversely  for  the  lower  visual  field. 
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Experiment  4:  Dominance  of  Horizontal  over  Vertical 
1  *  .  Circularvectio'n 

Method 

Continuous  circularvection  in  the  horizontal  plane 
implies  no  steady  state  conflict  with  information  stemming 
from  the  vestibular  system,  whereas  any  visually  induced 
rotation  in  the  vertical  plane  implies  a  conflict  with  gravi- 
receptor  signals.  It  would  be  expected,  therefore,  on  the 
basis  of  limitation  of  the  visually  induced  motion  effects  by 
vestibular  conflict,  that  rotation  in  the  horizontal  plane 
would  dominate  over  rotation  in  tha  vertical  plane.  The 
original  experiments  were  performed  on  seven  subjects  viewing 
the  rotating  stripe  display  in  the  Tflnnies1  optokinetic 
nystagmus  device  in  Zurich.  (The  details  of  the  stimulus  are 
described  in  Young  and  Henn,  1974.)  The  initial  visual  field 
movement  was  about  a  vertical  axis,  rotating  30°/sec.  After 
CV  was  reported,  the  axis  of  rotation  was  tilted  in  5°  incre¬ 
ments  in  roll,  so  that  it  had  successively  larger  horizontal 
components.  Each  step  lasted  at  least  30  seconds.  Observations 
were  made  with  roll  in  the  direction  of  the  yaw  circularvection 
and  in  the  opposite  c'rection.  Four  other  subjects  were  ex¬ 
posed  to  a  similar  stimulus  presentation  in  the  DMS  at  Langley, 
using  20°/sec  field  velocity.  In  each  case  subjects  were 
required  to  report  on  the  occurrence  of  apparent  rotary  motion, 
linearvection,  and  the  first  occurrence  of  any  self-motion  in 
the  vertical  plane,  be  it  tilt  or  linearvection. 

Results 


For  axes  tilted  by  5-10°  from  the  vertical,  the  sensation 
remained  one  of  pure  horizontal  circularvection,  and  the  linear 
motion  of  the  field  was  then  perceived  as  a  vertical  component 
of  the  visual  field,  independent  of  the  yaw  circularvection. 

At  fields  rotating  about  an  axis  tilted  by  more  than  20°  from 
the  vertical,  all  subjects  perceived  a  change  in  their  own 
orientation  in  the  vertical  plane.  This  was  variously  inter¬ 
preted  as  a  combination  of  pitch  and/or  vertical  translation 
combined  with  the  yaw  circularvection  to  give  the  sensation 
of  a  climbing  or  diving  turn.  The  median  tilt  angle  required 
to  generate  the  pitching  sensation  was  20°  with  a  range  from 
10°  to  60°  for  the  subject.  No  difference  was  seen  between 
the  results  in  the  smaller  structured  30°/sec  field,  tested 
in  Zurich,  and  the  larger,  20°/sec,  random  pattern  tested  at 
Langley . 

Discussion 


The  dominance  of  horizontal  circularvection  for  fields 
which  rotate  about  an  axis  up  to  10°  to  20°  from  the  vertical 
is  further  evidence  for  the  interpretation  that  moving  visual 
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fields  are  interpreted  in  terms  of  subjective  orientation  in 
a  manner  which  minimizes  the  dynamic  conflict  with  vestibular 
information.  Fields  rotating  about  u  vertical  axis  induce  a 
steady  horizontal  circularvection  which  is  consistent  with  a 
steady  state  null  signal  from  the  semicircular  canals  (indi¬ 
cating  constant  angular  velocity) .  Sensation  of  rotation 
about  an  off-vertical  axis,  on  the  other  hand,  would  imply 
the  expected  appearance  of  (sinusoidal)  time  varying  otolith 
signals  confirming  this  change  in  orientation.  Such  otolith 
information  is  not  forthcoming  in  the  head  fixed  experiments, 
and  therefore  the  perceived  axis  of  rotation  remains  vertical 
for  small  off-vertical  deviations  of  the  actual  field  rotation 
axis. 

Conclusions 

The  current  experiments  on  visually  induced  rotation 
sensation  in  pitch,  roll  and  yaw,  when  considered  with  an 
earlier  study  on  the  interaction  of  vestibular  and  visual 
stimuli  in  yaw,  support  an  interpretation  of  visual-vestibular 
interaction  in  human  spatial  orientation.  The  extent  to 
which  conflicting  sensory  information  can  be  treated  as  a 
linear  combination  of  the  effects  of  the  individual  stimuli 
is  limited.  Visually  induced  rotation  effects,  when  not  con¬ 
firmed  by  rotational  information  from  the  semicircular  canals, 
are  initially  rejected  in  favor  of  vestibular  information,  and 
only  dominate  in  the  steady  state,  when  they  are  consistent 
with  a  null  signal  from  the  semicircular  canals  indicating 
constant  velocity  rotation.  Some  neurophysiological  evidence 
for  this  interpretation  has  been  found  (Klinke  and  Schmidt, 
1970;  Dichgans  et  al,  1973;  Henn  et  al ,  1974)  for  visually 
induced  rotation  about  a  horizontal  axis.  In  pitch  or  roll, 
any  steady-state  angular  velocity  sensation  would  imply  a 
continuing  conflict  with  the  otolith  information.  The  re¬ 
sulting  sensation  of  limited  steady  tilt  would  resolve  the 
conflict  by  biasing  the  steady  otolith  information,  which 
can  be  considered  to  adapt  over  the  several  seconds  required 
for  the  illusion  to  develop.  This  interpretation  is  supported 
by  the  observation  that  the  visually  induced  pitch  and  roll 
magnitudes  vary  with  head  position  in  a  manner  predicted  by 
the  theoretical  sensitivity  of  the  utricular  otoliths  to 
tilt  from  those  head  positions. 

An  asymmetry  in  the  visually  induced  pitch  effect, 
favoring  the  pitch  forward  sensation  was  discovered,  and 
related  to  the  dominance  of  the  upper  visual  field  in  produc¬ 
ing  the  subjective  tilt. 
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FIGURE  LEGENDS 


Figure  1 

Figure  2 

Figure  3 
Figure  4 

Figure  5 
Figure  6 
Figure  7 


Latency  to  onset  of  yaw  circularvection.  Subjects,  pooling 
data  from  both  directions  when  available.  O  ■  individual 
reports.  -  means. 

Roll  tilt  angle  induced  by  full  field  rolling  visual  stimulus, 
as  a  function  of  pattern  speed  and  head  position.  Solid  lines 
connect  median  values  for  data  points  from  individual  subjects. 
Dichgans  et  al  (1973)  data,  shown  for  comparison,  used  a  130° 
field,  pooling  tilt  in  both  directions. 

Pitch  tilt  angle  induced  by  full  field  pitching  visual  stimulus. 
Individual  data  sad  median  lines. 

Sensitivity  to  visually  Induced  roll  as  a  function  of  head 
position  -  average  of  two  subjects.  Regression  line  slope 
units  deg/deg/sec  (see  text). 

Sensitivity  to  visually  induced  pitch  as  a  function  of  head 
position. 

Sensitivity  to  visually  induced  roll  as  a  function  of  field  size 
and  placement. 

Sensitivity  to  visually  induced  pitch  as  a  function  of  field  size 
and  placement. 
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ALCOHOL  EFFECTS  ON  DRIVING  BEKA'  'IOR  AND 
PERFORMANCE  IN  A  CAR  SIMULATOR* 

R.  Wade  Allen,  Henry  R.  Jex,  Duane  T.  McRuer, 
and  Richard  J.  DiMarco* 

Systems  Technology,  Inc.,  Hawthorne,  California 


ABSTRACT 

A  ioced-base  simulation  has  been  developed  to  test  the  effect  of  alcohol 
on  driving  performance.  The  simulation  includes  both  lateral  steering  control 
and  a  discrete  visual  detection,  recogn*  •i,  and  response  task,  set  up  to  pro¬ 
vide  the  workload  and  division  of  attention  typical  of  real  world  driving. 
Measurements  of  bot^  driver  control  behavior  and  driver/vehicle  performance  were 
obtained  for  the  steering  task,  and  detection  and  recognition  indexes  and  reac¬ 
tion  time  were  measured  on  the  discrete  task.  Preliminary  results  on  scanning 
behavior  as  measured  with  an  eye-point-of-regard  monitor  are  also  presented. 

Data  are  given  for  eighteen  drivers,  ranging  in  age  from  21 -65 >  at 
BAC  =  0,  0.06,  and  0.11  .  Alcohol  causes  larger  lane  and  heading  deviations, 
and  increases  detection  and  reaction  times  on  the  discrete  task.  Control- 
behavior  measures  show  that  the  driver's  control  gain  decreases  but  stability 
margins  are  maintained  under  alcohol,  while  driver  remnant  increases.  Such 
effects  could  be  due  to  indifference  thresholds  and/or  intermittent  attention 
in  the  control  task. 

Both  continuous  steering  control  and  discrete  peripheral  "sign"  response 
tasks  were  performed,  singly  and  combined,  to  investigate  the  effects  of  divided 
attention.  Performance  on  the  steering  control  task  was  decreased  when  bosh  tasks 
were  done  concurrently,  but  the  sensitivity  to  alcohol  effects  was  similar. 

The  driving  simulation  has  proven  an  efficient  tool  for  alcohol  research. 

It  has  gained  acceptance  from  subjects  as  a  valid  approximation  of  driving, 
and  the  various  related  measurements  have  proven  to  be  reliable  and  sensitive 
to  levels  of  intoxication. 


*This  work  was  sponsored  under  Contract  D0T-HS- 227- 2-388  by  NHTSA's  Office 
of  Driver  Performance,  with  Dr.  Leland  Summers  as  Contract  Technical  Manager 

t Senior  Research  Engineer,  Principal  Research  Engineer,  Technical  Director, 
and  Staff  Engineer,  Analytical,  respectively. 


INTRODUCTION 


The  epidemiological  connection  of  alcohol  with  automobile  accidents  is 
fairly  well  established  (e.g.,  Refs.  1  and  2).  It  has  been  found  that  the 
probability  of  involvement  in  serious  crashes  increases  dramatically  for 
blood  alcohol  concentration  beyond  0.08  g/lOO  ml*  (Ref.  3).  A  great  deal 
of  research  has  been  devoted  to  identifying  driving- relevant  behavior 
impaired  by  alcohol.  Past  studies  have  employed  a  range  of  approaches 
including  actual  field  test  situations  (e.g..  Refs.  2  and  4),  laboratory 
driving  simulations  (e.g..  Refs.  5  and  6),  and  simpler  laboratory  tasks 
which  measure  psychomotor  and/or  cognitive  skills  (e.g.,  Refs.  7  and  8). 

Although  alcohol  studies  are  hampered  in  general  by  procedural  problems 
with  dosage  administration  and  measurement,  and  between- subject  variability 
due  to  motivation  and  personality  factors,  some  relatively  generalizable 
results  have  surfaced  from  past  research.  First,  the  performance  on  divided 
attention  tasks  seems  particularly  sensitive  to  alcohol  (Ref.  8-10).  Further, 
in  tasks  requiring  peripheral  visual  detection,  alcohol  seems  to  cause  a 
"tunneling"  effect  such  that  peripheral  information  is  either  missed,  ignored, 
or  results  in  increased  reaction  times  over  sober  performance  (Refs.  9  and  11 ). 
Finally,  although  it  has  proven  difficult  to  correlate  the  effects  of  alcohol 
on  simple  laboratory  psychomotor  tests  with  simulated  and  actual  driving  per¬ 
formance  (Refs.  6  and  12),  alcohol  does  consistently  degrade  driving  perfor¬ 
mance  both  in  terms  of  lateral  (lane)  position  control  (Refs.  6  and  13)  and 
response  to  discrete  events  (Refs.  5,  13-1 4). 

A  great  deal  of  effort  has  been  devoted  to  determining  the  behavioral 
elements  associated  with  discrete  tasks,  such  as  detection,  information  pro¬ 
cessing,  etc.,  that  are  degraded  by  alcohol  (Refs.  5,  10-11).  This  level  of 
effort  has  not  been  carried  through  to  the  continuous  control  behavior  portion 
of  driving,  however,  which  produces  lane  deviations  that  ultimately  influence 
the  probability  of  accident  involvement. 


"'Blood  alcohol  levels  are  given  here  in  conventional  units  of  grams 
ethanol  per  100  millileters  of  blood,  as  measured  by  breath  alcohui  con¬ 
centration,  BAC  (Ref.  23). 


Research  on  driver  control  behavior  has  often  been  stymied  in  the  past  by 
the  lack  of  appropriate  behavioral  models  and  efficient  measurement  technique s; 
however,  recent  advances  in  manual  control  technology  have  changed  this  situa¬ 
tion.  Guidance  and  control  laws  for  driver/car  steering  have  been  developed 
and  analyzed  (Ref.  15),  and  validated  with  simulator  and  field  test  measurements 
(Refs.  16  and  17).  Finally,  efficient  procedures  have  been  developed  which 
allow  the  driver's  complex  multiloop  control  behavior  to  be  interpreted  with 
simple  describing  function  measurements  (Ref.  18). 

The  purpose  of  this  paper  is  to  describe  a  simple,  yet  realistic  and 
relevant,  set  of  laboratory  driving  tasks  and  to  present  results  from  their 
use  in  a  study  of  the  basic  effects  of  alcohol  on  driving.  The  driving 
tasks  included  both  continuous  steering  control  and  discrete  visual-motor 
response  tasks  requiring  detection,  scanning,  and  recognition.  The  two 
types  of  task  were  performed  both  separately  and  in  combination  in  order 
to  determine  the  effect  of  task  interference  on  alcohol  impairment.  The 
other  objective  of  this  research  was  to  determine  if  there  xS  differential 
impairment  between  moderate  and  heavy  drinkers,  and  these  results  are  pre¬ 
sented  in  a  companion  paper  (Ref.  19). 

SIMULATION  AND  MEASUREMENTS 

Past  research  has  shown  divided  attention  tasks  to  be  sensitive  to  alcohol 
impairment,  and  in  fact  typical  driving  situations  involve  a  combination  of 
both  continuous  control  behavior  and  visual  monitoring  of  discrete  events, 
performed  in  parallel  (Ref.  20).  Accordingly,  our  simulation  was  set  up  to 
present  the  driver  with  both  types  of  tasks  as  shown  in  Fig.  1,  for  which 
the  scenario  was  driving  on  a  rural  road  at  night  in  stormy  weather.  The 
driver's  control  task  was  to  drive  down  the  center  of  a  lane  presented  on 
a  CRT  display,  while  regulating  against  disturbances  similar  to  those  caused 
by  wind  gusts  and/or  road  roughness.  Ti  discrete  task  consisted  of  peri¬ 
pheral  "signs"  which  randomly  flashed  ir.  .ssages  requiring  response  with  the 
horn  or  brake.  The  details  of  tne  tasks  and  measures  are  as  follows. 


Steering  Control  T&ak 


The  control  task  scenario  was  similar  to  driving  down  a  single  lane  road 
at  night.  The  lane  edges  were  drawn  in  perspective  on  the  CRT  with  decreasing 
intensity  in  the  distance.  Reading  and  lane  deviations  of  the  car  were  repre¬ 
sented  properly  oy  motions  of  the  road  relative  to  a  fixed  mask  of  a  car  hood, 
left  fender,  and  windshield  outline  as  shown  in  Fig.  1.  An  8"  x  10"  CRT  was 
used  and  the  entire  scene  (mask  and  road)  scaled  down  by  0.6  times  in  order 
to  preserve  the  natural  framing  provided  in  a  real  car.  A  modified  1968 
Mustang  cab  was  used  with  the  CRT  mounted  on  the  hood  24  in.  in  front  of 
the  driver.  The  steering  wheel  feel  was  set  up  tc  approximate  the  force  feel 
characteristics  of  a  power  steering  unit. 

Two-degree-of- freedom  equations  were  used  for  the  car  dynamics  (Refs.  16 
and  18)  such  that  steering  wheel  inputs  generate  heading  (ty)  and  lateral  (y) 
deviations  which  then  drive  the  display.  The  dynamics  used  for  this  study 
were  representative  of  en  American  sedan  traveling  at  30  mph  and  are  summarized 
in  Table  1.  A  disturbance  signal  was  combined  with  the  driver's  steering 
signal  as  shown  in  Fig.  1,  to  simulate  an  equivalent  wind  gust  input  against 
which  the  driver  had  to  regulate  in  order  to  maintp'.n  a  center  lane  position. 
The  disturbance  was  composed  of  a  sum  of  five  nonharmonically  related  sinusoids 
which  appeared  subjectively  to  be  random. 

The  driver's  steering  behavior  is  modeled  as  quasi- linear  response 
operations  on  and  y,  plus  an  additive  noise  (remnant)  as  shown  in  Fig.  1. 

It  is  the  parameters  characterizing  these  two  processes  that  we  wish  to 
measure  in  order  to  define  tne  effect  of  alcohol  on  driver  control  behavior. 

The  driver's  dynamic  response,  Y*,  characterizes  the  portion  of  total  steer¬ 
ing  control  linearly  correlated  with  heading  and  lateral  deviations  of  the 
car.  Since  the  perspective  display  is  integrated  and  perceived  as  an  entity, 
it  is  difficult  to  determine  the  manner  in  which  ijr  and  y  information  is 
combined  and  processed.  This  problem  is  circumvented,  however,  with  a 
recent  development  in  multiloop  car/driver  measurement  (Ref.  18).  The 
technique  results  in  an  equivalent  single-loop  measurement  of  the  driver's 
describing  function,  Yp  which  combines  the  individual  operation  on  functions 
of  and  y.  A  typical  form  of  Y*  is  shown  in  Fig.  2.  The  magnitude  of  the 
low-frequency  amplitude  reflects  the  driver's  sensitivity  (gain)  to  path  error 
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EQUIVALENT  DRIVER  DESCRIBING  FUNCTION  AMPLITUDE 
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(Ky),  while  the  mid-  and  high-frequency  amplitude  reflect  heading  sensitivity 
(K^).  The  high-frequency  break  point  represents  lead  (anticipation)  generated 
by  the  driver  to  offset  the  lags  in  the  vehicle  heading  response  (Refs.  15 
and  18).  Generally,  higher  open-loop  gains  imply  better  closed-loop  perfor¬ 
mance,  up  to  the  level  at  which  stability  margins  are  reduced  to  the  point 
of  diminishing  returns,  and  oscillatory  resonance  sets  in. 

The  above  measurements  were  made  using  the  STI  Describing  Function  Analyzer 
(Ref.  21 )  as  shown  in  Fig.  1 .  Associated  performance  measurements  were  also 
obtained  with  an  analog  computer  and  combined  in  further  off-line  data  pro¬ 
cessing  to  yield  a  comprehensive  set  of  performance  and  underlying  driver 
control  dynamic  response  measurements.  The  dynamic  response  measurements 
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included  the  equivalent  driver  describing  function,  Yp( jw);  unity-gain  anrt 
180-deg-phase  "crossover"  frequencies  (u)C,  uu)  which  are  measures,  respectively, 
of  the  actual  and  maximum  achievable  heading  loop  bandwidth;  phase  margin  (p^), 
a  measure  of  the  heading  loop  closure  stability  margin;  system  rms  perfor¬ 
mance  measures  of  key  signals  such  as  steering  wheel  motion  (6S),  heading 
(\|r),  and  lane  deviation  (y)j  and  overall  linear  coherency  of  the  driver's 
steering  action  relative  to  the  input  disturbance  (pfs)  in  which  deviation 
from  unity  gives  a  measure  of  the  remnant  generated  by  the  driver.  A  typical 
run  lasted  120  seconds  with  the  above  measurements  made  over  the  last  100  sec. 

Visual  Detection  Task 

The  visual  detection  task  was  set  up  to  represent  discrete  events  that 
the  driver  might  encounter  up  ahead  beside  the  road  or  through  his  rearview 
mirrors,  and  require  response  reflexes  typical  of  driving.  Back-projected 
one-inch  indicator  lights  (IEE  Series  0120)  were  mounted  in  the  standard 
rearview  mirror  positions  (roughly  ±45  deg  off  center  and  at  ±20  deg  on  either 
side  of  the  CRT  roadway  display  as  shown  in  Fig.  1  .  Each  indicator  presented 
the  messages  [HORN]  or  [BRKE],  requiring  the  subject  to  respond  by  depressing, 
respectively,  the  horn  ring  or  brake  pedal.  The  message  was  approximately 
0.1 8"  X  0.56"  in  size  and  the  brackets  were  used  to  preclude  the  driver  from 
recognizing  the  message  content  parafoveally .  The  message  brightness  was 
adjusted  through  trial  and  error  to  be  just  barely  supra- threshold  for  para¬ 
foveal  detection  under  sober  conditions. 

The  indicator  units  were  driven  by  a  special  purpose  Digital  Logic  Unit 
(DLU)  and  event  programmer  which  activated  the  messages  in  quasi-random 
sequences  among  the  four  indicators.  Four  different  programs  were  used  to 
minimize  chances  of  learning  the  sequences.  During  a  100-second  run,  four 
messages  were  presented  on  each  indicator  (2  HORN,  2  BRKE),  with  the  order  of 
indicator  and  message  randomized  and  counterbalanced  during  a  run.  The  inter¬ 
message  interval  varied  between  one  and  five  seconds  and  was  also  randomized. 

The  DLU  also  accumulated  the  number  of  correct  responses,  the  number  of  missed 
responses,  and  the  reaction  time  of  all  responses.  Each  message  was  presented 
for  (nominally)  three  seconds,  and  responses  beyond  this  interval  were  counted 
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as  misses.  As  a  result  of  subsequent  off-line  processing,  the  accumulated 
data  were  reduced  to  measures  of  signals  detected,  signals  correctly  responded 
to,  and  average  reaction  time. 

In  order  to  gain  insight  into  the  eye  scanning  process  for  the  present 
task  setup,  eye  motions  were  recorded  during  selected  runs  using  an  STI  EPR-2 
eye-point-of- regard  monitor  (Ref.  22).  This  device  provides  a  continuous 
indication  of  vertical  and  horizontal  head  and  eye  points-of-regard.  It  con¬ 
sists  of  a  goniometer,  held  fixed  relative  to  the  subject's  head  by  a  rigid 
bite,  and  four  light-sensitive  sensors  mounted  on  modified  eyeglass  frames. 

The  goniometer  measures  head  movement  while  the  frame-mounted  sensors  measure 
eye  movement  relative  to  the  head.  EPR-2  electronics  provide  for  individual 
adjustment  and  sensitivities  of  the  goniometer  and  each  of  the  sensors,  and 
subsequent  combining  of  goniometer  and  sensor  outputs  to  provide  eye  point- 
of-regard  with  respect  to  an  cab-fixed  reference. 

EXPERIMENTAL  METHODS  AND  PROCEDURES 

The  subject  population  for  the  experiment  consisted  of  18  licensed 
drivers  (17  males,  1  female)  screened  for  normal  intelligence  (on  the  basis 
of  results  on  a  shortened  version  of  the  Shipley-Hartford  Test,  Ref.  24). 
Selected  subjects  were  equally  divided  between  moderate  and  heavy  drinkers 
and  were  further  selected  to  span  the  age  range  21-65.  This  aspect  of  the 
study  is  discussed  in  detail  in  a  companion  paper  (Ref.  19).  The  subjects 
were  given  training  on  the  task  during  2  sessions  and  performed  the  test 
battery  (i.e.,  driving  task  only,  sign  task  only,  and  combined  driving  and 
sign  tasks)  5  to  9  times  prior  to  the  formal  data  sessions.  Three  subjects 
each  from  '.he  moderate  and  heavy  drinker  categories  were  also  selected  to  run 
single-blind  placebo  sessions  in  addition  00  their  formal  test  sessions  to 
determine  whether  other  factors  such  as  fatigue  or  learning  might  appreciably 
influence  task  performance  during  the  formal  data  sessions.  Subjects  were 
tested  in  groups  of  two  to  four,  usually  including  one  placebo. 

Formal  data  sessions  were  begun  in  the  morning  or  early  afternoon, 
and  subjects  were  asked  to  refrain  from  eating  immediately  prior  to  reporting 
on  the  test  day  in  order  to  obtain  maximum  alcohol  absorption  rates.  Subjects 
were  administered  a  warmup  run  and  formal  baseline  tests  prior  to  receiving 
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their  first  drink.  During  normal  drinking  sessions  it  was  desired  to  test 
subjects  at  ascending  and  descending  blood  alcohol  concentrations  (BAC)  of 
nominally  0.06  and  peak  levels  of  0.11  (just  beyond  the  legal  limit  for 
intoxication  in  many  states).  BAC  was  measured  with  a  Mark  II  Gas  Chromato¬ 
graph  Intoximeter.  Heavy  drinkers  were  also  tested  in  additional  sessions 
at  higher  BAC's,  and  this  data  is  discussed  in  Ref.  19* 

A  lounge  with  games  and  reading  material  was  provided  for  the  subjects' 
relaxation  during  drinking  and  resting  between  tests  in  order  to  promote  a 
modest  social  atmosphere.  The  drinks  consisted  of  vodka  or  whiskey  (for  a 
few  subjects  who  refused  to  drink  vodka),  diluted  to  20  percent  ethanol  con¬ 
centrations  with  a  standard  mixer .  Alcohol  dosage  was  adjusted  for  body  weight 
to  yield  desired  BAC's.  Subjects  were  given  two  drinks  calculated  to  give  a 
nominal  ascending  BAC  of  0.06  for  testing.  A  third  drink  was  then  given  to 
allow  achievement  of  a  maximum  BAC  on  the  order  of  0.11.  After  testing  at 
maximum  BAC,  subjects  were  given  a  meal,  with  no  further  drinks,  and  a  final 
test  was  run  at  a  nominal  descending  BAC  of  0.06.  A  plot  of  the  mean  and 
standard  deviation  of  BAC's  achieved  over  all  subjects  as  a  function  of  time 
is  given  in  Fig.  3.  For  placebo  subjects  a  small  amount  of  vodka  was  "floated" 
on  top  of  a  glass  of  their  customary  mix  to  give  the  illusion  of  a  mixed  drink. 
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Figure  3.  BAC  as  a  Function  of  Time  Averaged  Over  Subjects 
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RESULTS 


Typical  time  traces  of  experimental  trials  conducted  under  sober  and 
intoxicated  conditions  are  shown  in  Fig.  4,  and  exhibit  many  of  the  experi¬ 
mental  effects  of  alcohol  on  driving.  For  the  continuous  task,  it  is  apparent 
that  both  the  heading  and  lane  deviations  of  the  car  increase  under  alcohol. 

Also,  the  driver's  steering  actions  seem  to  be  less  responsive  with  longer 
periods  of  constant  wheel  position  under  alcohol,  although  wheel  motion  does 
roughly  correspond  to  the  input  disturbance  as  it  should  for  regulation 
against  the  disturbance. 

From  a  diagnostic  standpoint,  the  EFR  data  allow  the  partitioning  of 
the  multiphasic  discrete  task  response  process  into  its  components  as  quanti¬ 
fied  by  the  time  interval  allotted  to  each  phase  (initial  delay  to  scan  initia¬ 
tion,  scan  dwell,  and  time  to  respond  following  the  initial  scan) .  By  such 
partitioning,  the  individual  contributions  of  each  phase  to  overall  perfor¬ 
mance  degradation  can  be  assessed. 

For  the  discrete  task  the  EPR  (eye-point-of- regard)  trace  shows  that 
the  driver  did  not  continuously  scan,  but  looked  away  from  the  road  (CRT)  in 
response  to  the  appearance  of  sign  messages,  although  under  alcohol  there  are 
several  cases  of  extra  scans.  This  behavior  is  consistent  with  the  stated 
primary  nature  of  the  control  task  and  indicates  the  signs  were  detected 
parafoveally.  Event  "detection"  is  indicated  by  a  scan  in  the  correct  direction. 

Under  sober  conditions  the  scanning  is  made  with  single,  rapid  saccades 
(Fig.  4).  Scans  are  initiated  shortly  after  message  onset  and  last  0.3- 
0.5  seconds,  and  taere  is  no  apparent  interaction  with  steering  wheel  motions 
during  the  scanning  and  response  processes.  Under  alcohol  the  scanning  is 
much  more  sluggish,  however,  with  multiple  saccades  and  dwells  on  the  order 
of  0.6- 1.0  seconds  which  seems  to  correlate  with  a  slight  increase  in  the 
total  response  reaction  time.  There  is  also  evidence  of  holds  in  the  steer¬ 
ing  action  under  alcohol  during  the  scanning  and  response  process.  Previous 
research  (Ref.  25)  including  the  sober  data  here  has  not  shown  this  type  of 
interference  which  may  be  a  unique  alcohol  effect. 

A  preliminary  review  of  EPR  data  from  two  subjects  indicates  that  Lhe 
typical  response  process,  sober,  can  be  broken  down  into:  a  0.2-0. 4  second 
initial  delay  between  event  onset  (sign  light-up)  and  the  beginning  of  the 
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eye  motion  from  the  roadway  to  the  sign;  a  0.3-0. 6  second  dwell  period  during 
which  the  subject  "recognizes"  the  sign;  and  a  0. 1-0.3  second  interval 
preceding  response  to  the  sign,  after  the  eyes  have  returned  to  the  roadway. 
With  increasing  BAC,  typical  initial  delay  and  dwell  increased,  reaching 
values  of  0.1+-0.9  seconds  and  0.7-I.I  seconds,  respectively,  at  peak  BAC, 
while  the  time  to  respond  after  scan  diminished  until  both  subjects  would 
frequently  respond  before  looking  back  to  the  roadway.  Behavior  for  the 
discrete- task- only  was  markedly  different.  While  typical  detection  delays 
were  generally  comparable  to  those  observed  for  the  combined  task,  typical 
scan  dwell  was  always  larger  and  the  EPR  usually  returned  to  the  road  just 
after  the  response  was  made. 

Under  sober  and  intoxicated  conditions,  the  response  process  was  more 
consistent  and  showed  much  less  evidence  of  random  scanning  (and  no  sober 
random  scanning)  when  combined  with  the  driving  task.  Other  idiosyncratic 
behavior  exposed  by  the  EPR  measurements  included  scanning  from  one  roadway 
edge  to  the  other  rather  than  using  a  single  fixation  point  for  the  continuous 
task  reference  and  occasional  failure  to  respond  to  signs  after  detection  and 
apparent  visual  recognition  (verifying  subject's  comments  to  that  effect) 
while  under  the  influence  of  alcohol. 

While  the  above  results  are  tentative,  it  is  apparent  that  the  EPR  data 
can  contribute  considerable,  and  otherwise  unavailable,  insight  to  the  scan¬ 
ning  and  response  processes  involved  in  driving  and  their  deterioration  under 
alcohol.  Further  analysis  along  these  lines  should  be  quite  fruitful. 

Analysis  of  the  placebo  data  showed  little  effect  on  task  performance 
during  a  given  experimental  session.  Also  analysis  of  the  ascending  vs. 
descending  data  at  comparable  BAC's  failed  to  show  any  appreciable  effect  on 
performance.  Consequently,  the  following  discussion  will  be  confined  to 
results  obtained  at  the  baseline,  ascending,  and  maximum  levels  of  BAC  (Fig.  3). 

Performance  data  averaged  across  18  subjects  is  plotted  in  Fig.  5. 

Steering  activity  and  heading  and  lane  deviations  generally  increase  with 
BAC.  The  addition  of  the  discrete  task  causes  a  constant  increment  in  steer¬ 
ing  activity  and  heading  deviations,  while  only  the  sensitivity  of  decre¬ 
ments  to  BAC  is  increased  by  the  divided-attention  nature  of  the  combined 
task.  The  combined-task  results  show  that  path- following  errors  double 
(O.65  -►1.3  feet)  when  attentions!  demands  are  placed  on  the  intoxicated 
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Figure  5 


ALCOHOL  EFFECTS  ON  DRIVING  CONTROL 
PERFORMANCE  AVERAGED  OVER  SUBJECTS 
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driver.  The  occasional  peak  deviations  of  a  random  path  with  this  rms  level 
will  clearly  extend  a  car  past  lane  boundaries  or  off  on  the  shoulder  of  a 
single  lane  road  which  increases  the  probability  of  accident  involvement . 

Driver  control  behavior  responsible  for  the  above  performance  effects 
is  shown  in  Fig.  6.  From  the  averaged  describing  function  data  it  is  obvious 
that  the  driver's  sensitivity  or  gain  is  reduced  when  he  is  intoxicated. 

This  is  particularly  true  in  the  low-frequency  region  which  mainly  influences 
path  following  errors.  The  describing  function  phase  data  (Fig.  6a)  are  not 
particularly  affected,  so  the  change  in  the  driver's  dynamic  response  under 
alcohol  is  mainly  a  gain  phenomenon.  Furthermore,  alcohol  acts  to  increase 
driver  remnant  (Fig.  6b). 

Both  the  remnant  and  describing  function  results  might  be  explained 
by  an  increase  in  intermittency*  and/or  indifference  threshold*.  Alcohol  may 
increase  the  driver's  indifference  threshold  to  lane  deviations,  a  nonlinear 
behavior  which  would  increase  remnant  while  at  the  same  time  reducing  measured 
gain.  Also,  as  suggested  by  the  time  trace  data  in  Fig.  A,  the  discrete- sign- 
task  interference  under  alcohol  seems  to  elicit  intermittent  steering  actions, 
which  could  lead  to  further  remnant  increase  and  gain  reductions  as  shown  in 
Fig.  6. 

In  spite  of  the  changes  in  dynamic  response  described  above,  alcohol  does 
not  seem  to  decrease  the  basic  closed-loop  stability  of  the  driver /vehicle 
system,  as  shown  in  Fig.  7-  The  crossover  frequencies  and  phase  margin  are 
computed  from  the  equivalent  single -loop  driver /vehicle  dynamics  and  relate 
mainly  to  the  heading  control  loop.  While  the  gain  crossover  frequency 
decreases  under  alcohol,  which  is  consistent  with  the  describing  function 
data  in  Fig.  6,  the  phase  margin  stays  relatively  constant.  In  a  similar 
vein,  oou  and  u^  change  uniformly  implying  a  constant  gain  margin.  Also,  with 

‘indifference  Threshold  =  thresholds  in  a  perceptual-motor  control  loop 
which  are  not  specifically  sensory  or  proprioceptive  threshold;  e.g.,  con¬ 
trol  inaction  while  the  error  is  within  some  tolerance  zones  (Ref.  24). 

tAttentional  Intermittency  =  switching  of  control  attention  frequently, 
and  usually  asynchronously,  from  task  to  task  (or  loop  to  loop);  often  (but 
not  always)  evidenced  by  eye-point- of- regard  or  control  inactivity  (e.g.. 
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the  added  distraction  of  the  sign  task,  the  driver  lowers  his  gain  to  further 
increase  his  stability  margin.  Finally,  all  the  dynamic  response  and  remnant 
data  show  similar  effects  between  the  single  and  combined  tasks,  implying 
little  influence  of  divided  attention  on  the  driver's  control  behavior. 

Performance  on  the  discrete  task  is  plotted  in  Fig.  3.  The  response 
ratio,  %/N,  is  the  fraction  of  signals  responded  to,  and  gives  a  measure 
of  signal  detectability.  Dectection  decreased  with  increasing  BAC,  and 
the  added  distraction  of  the  control  task  seems  to  add  en  extra  decrement 
at  high  blood  alcohol  levels.  Signs  were  seldom  incorrectly  responded  to 
(less  than  3  percent  at  0.1  BAC),  so  this  was  not  a  factor  in  task  perfor¬ 
mance.  The  response  times  to  the  signs  generally  increased  with  BAC  and 
was  not  influenced  by  the  presence  or  absence  of  the  control  task.  Finally, 
the  reaction  times  measured  here  are  quite  similar  to  past  simulator  results 
(Ref.  5). 

DISCUSSION 

The  results  presented  so  far  show  a  general  deterioration  in  performance 
with  increasing  BAC  in  both  the  continuous  and  discrete  tasks.  The  effects 
occur  both  when  the  tasks  are  performed  singly  and  in  combination*  however, 
the  divided  attention  aspect  of  the  combined  task  does  not  seem  to  have 
affected  the  general  sensitivity  of  the  results  to  BAC,  except  for  the  path 
deviation.  In  order  to  further  substantiate  these  findings,  the  key  measure¬ 
ments  were  subjected  to  analysis  of  variance  procedures,  and  the  results 
are  summarized  in  Table  2. 

The  BAC  level  effect  was  highly  significant  for  all  parameters  as  indicated 
in  Table  2,  except  phase  margin  (cp^),  which  was  previously  noted  to  remain 
relatively  constant  over  the  range  of  BAC's  tested.  The  Task  effect  in  Table  2 
shows  that  performance  of  the  steering  task  was  significantly  impaired  by  the 
presence  of  the  discrete  task*  however,  the  reverse  was  not  true.  This  is 
possibly  because  the  discrete  task  interrupts  the  continuous  nature  of  the 
steering  task*  whereas  the  discrete  task  is  always  performed  on  demand,  so 
the  detection  process  is  not  interferred  with.  The  3-0  sec  "gate"  on  the 
signs  probably  motivated  this  behavior  tc  a  certain  extent,  which  is  realistic 
in  the  driving  context  where  signs,  unexpected  obstacles,  etc.,  must  be  reacted 
to  before  they  are  overrun.  (At  30  mph,  the  car  travels  132  ft  in  3  seconds.) 
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tThe  experimental  design  included  all  combinations  of  BAC  Level  and  Task.  Subjects  were 
also  included  as  a  variable  in  the  analysis,  and  were  further  subdivided  into  groups  by 
drinking  habit  and  age,  thus  resulting  in  a  nested  design  for  the  complete  analysis.  Sub¬ 
jects  were  considered  a  random  variable  and  subject  interactions  were  used  for  the  F  ratio 


Finally,  Table  2  bears  out  the  previously-noted  result  that  there  is  no 
significant  interaction  between  BAC  and  Tasks  other  than  for  the  lane  devia¬ 
tion  measurement.  This  one  exception  is  quite  important,  however,  since 
lane  deviations  influence  the  probability  of  accident  involvement . 


CONCLUDING  REMARKS 


A  rather  simple,  yet  directly  driving -relevant,  fixed-base  laboratory 
driving  simulator  was  developed  which  has  elicited  many  of  the  anecdotal 
phenomena  attributed  to  intoxicated  drivers  in  past  investigations.  With 
a  scenario  of  driving  on  a  rural  road  on  a  stormy  night,  the  simulation 
gained  the  acceptance  cf  the  18  typical  drinking  driver  subjects  and  has 
provided  a  reliable  data  base  with  many  clearcut  effects.  The  more  impor¬ 
tant  findings  may  be  summarized  as  follows: 

Driving  Task 

•  Lane  deviations  increase  with  BAC  level,  which  is  explained 
by  measures  of  lower  driver  control  gain  and  increased  rem¬ 
nant.  Distraction  of  the  sign  response  task  further  increased 
the  impairment  of  path  control  by  alcohol.  These  effects  are 
consistent  with  increased  indifference  thresholds  and/or 
control  intermittency  and  si  piificantly  increase  the  proba¬ 
bility  of  lane  exceedances. 

•  Heading  control  gain  also  decreases  under  alcohol  with  a  con¬ 
comitant  increase  in  heading  deviations.  Phase  margin  for 
the  heading  loop  closure  remains  constant  under  alcohol, 
however,  so  that  intoxication  apparently  does  not  decrease 
control  stability. 

Discrete  Task 

•  The  fraction  of  misses  and  the  response  time  increase  under 
alcohol,  while  incorrect  responses  are  negligible  under  all 
conditions  up  to  BAC  =  0.11. 

•  The  driving  task  does  not  interfere  with  the  discrete  task 
in  either  the  detection  or  response  processes,  indicating 
the  signs  are  acted  upon  on  demand  much  as  might  be  expected 
in  a  real  driving  situation  in  response  to  signals,  unexpected 
obstacles,  etc. 
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•  EPR  (eye-point-of- regard)  measurements  show  that  drivers  do 
not  continuously  scan  for  signs.  Scans  are  normally  prompted 
by  peripheral  detection  of  a  sign,  although  occasional  unneces¬ 
sary  scans  occur  at  higher  BAC.  Scanning  is  degraded  in  general 
under  alcohol,  and  an  observed  increase  in  scan  dwells  may  be 
partially  responsible  for  increased  reaction  times  and  inter¬ 
ference  with  the  steering  control  task. 

•  The  EPR  measurenents  have  given  a  great  deal  of  insight 
into  the  detection  and  response  p:  cesses  in  the  discrete 
task  and  further  analysis  of  the  simultaneously  recorded 
EPR,  discrete  response,  and  steering  data  would  be 
fruitful. 


This  simulation  was  used  successfully  (in  an  experiment  interleaved 
with  this  one)  to  investigate  effects  of  different  drinking  habits  (Moderate 
vs.  Heavy)  on  the  various  measures  of  driving  performance  and  behavior  (Ref.  19) 
and  additional  data  therein  on  heavy  drinkers  at  0,  0.11,  and  0.1 6  BA.C  tends 
to  support  and  extend  the  present  findings. 
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IMPAIRMENT  07  MODERATE  VERSUS  HEAVY  DRINKERS 
IN  SIMULATED  DRIVING  TAS13* 

Henry  R.  Jex,  Richard  J.  DiMarco,  and  R.  Wade  Allen* 
Systems  Technology,  Inc.,  Hawthorne,  California 


ABSTRACT 


The  objective  of  this  program  was  to  test,  under  carefully  controlled 
and  measured  conditions  at  various  blood  alcohol  concentrations,  whether  or 
not  Heavy  drinkers  (i.e.,  those  who  ususally  exceed  0.10  BAC  when  drinking) 
might  have  different  driving  impairment  than  Moderate  drinkers  (i.e.,  those 
who  seldom  reach  0.10  BAC  when  drinking).  Two  groups  of  ten  drinking  drivers, 
representing  a  typical  distribution  of  age,  education,  and  occupation  were 
selected  to  have  drinking  habits  near  either  extreme.  The  primary  task 
was  a  steering  control  task  in  the  presence  of  crosswind  gust  disturbances 
using  a  roadway  perspective  display  in  the  ST1  Fixed- Base  Car  Simulator.  A 
secondary  discrete  task  included  detection,  interpretation,  and  response  to 
simulated  "signs"  located  at  ±20  deg  and  ±45  deg  in  the  peripheral  fields. 

(The  methods,  setup,  and  comprehensive  measurement  schemes  are  described  in 
a  companion  paper.  Ref.  6).  Two  interleaved  experiments  were  performed.  In 
one,  both  Moderate  and  Heavy  drinkers  went  to  just  over  legal  limits  (Blood 
Alcohol  Concentration,  BAC  =  0.11  g/100  ml),  and  in  the  other  the  Heavy 
drinkers  went  up  to  BAC  =  0.1 6.  The  experiment  design  included  a  test  bat¬ 
tery  of:  steering  only,  discrete  task  only,  and  combined  tasks)  partial 
placebo  sessions;  and  tests  during  sober  (baseline),  ascending,  peak,  and 
descending  BAC  phases.  Also  presented  are  some  eye  motion  traces  giving 
insight  as  to  the  nature  of  the  discrete  task  decrements. 

Results  showed  that  Heavy  drinkers  were  less  impaired  than  Modere  e 
drinkers  at  0.11  BAC  (near  legal  limits),  in  terms  of  larger  heading  and 
path  errors,  describing  function  gain  decrements,  increased  remnant,  more 
discrete  task  misses,  and  longer  response  times.  However,  the  Heavy  drinkers 
were  somewhat  more  impaired  at  0 . 1 6  BAC  than  the  Moderate  drinkers  at  then  r 
0.11  BAC  peak. 

Based  on  lane  deviation  variance,  the  probability  of  lane  exceedance  of 
a  standard  sedan  in  a  12- foot  lane  was  increased  from  0.0001  when  sober  to 
0.05  for  the  Moderate  drinkers  at  0.11  BAC,  and  for  the  Heavy  drinkers  to 
0.01  at  0.11  BAC  and  to  0.10  at  0.1 6  BAC.  A  number  of  the  observed  effects 
of  BAC  (i.e.,  worse  performance,  lower  driver  sensitivity  to  lane  and  heading 


*This  work  was  sponsored  under  Contract  D0T-HS- 227-2-388  by  NHTSA's  Office 
of  Driver  Performance  Research,  with  Dr.  Leland  Summers  as  Contract  Technical 
Manager. 

*  Principal  Research  Engineer;  Staff  Engineer,  Analytical;  and  Senior 
Research  Engineer,  respectively. 
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deviations,  less  control  coherency,  constant  stability  margins,  and  missing 
of  discrete  responses  despite  their  accurate  peripheral  detection)  are  all 
consistent  with  an  increase  in  the  intoxicated  driver's  indifference  thres¬ 
holds  and/or  attentional  intermittency. 


INTRODUCTION 

Objective* 


The  underlying  motivation  behind  the  present  research  has  been  clearly 
stated  by  the  Office  of  Driver  Performance  Research  of  the  National  Highway 
Traffic  Safety  Administration  (NHTSA)  in  Ref.  1,  as  follows: 

"The  1968  Alcohol  and  Highway  Safety  Report  showed  that  alcohol 
related  accidents  account  for  50$  of  the  highway  fatalities  and 
that  80$  of  these  fatalities  have  blood  alcohol  concentrations 
of  0.10$  or  higher.  It  has  also  been  shown  that  the  accident 
risk  factor  increases  6  and  20  fold  for  BAC  levels  of  0.10$ 
and  0.15$  (Ref.  2)  respectively  and  the  fatality  risk  factor  is 
9  and  35  fold  for  the  same  BAC  levels  (Ref.  3).  It  has  also  been 
found  that  heavy  users  of  alcohol  were  over  represented  among 
those  responsible  for  fatal  and  serious  injury  accidents  and 
among  those  convicted  of  driving-while-intoxicated  or  other 
serious  moving  violations  (Ref.  2).  In  fact  it  is  generally 
concluded  that  problem  drinkers  who  constitute  a  small  portion 
of  the  population  account  for  a  very  large  part  of  the  overall 
problem  (1968  Alcohol  and  Highway  Safety  Report). 

Past  and  current  research  on  alcohol  and  driving  has  shown  that 
alcohol  impairs  driving  and  performance  tests  related  to  driving. 
However,  the  majority  of  this  research  was  performed  on  college 
students  who  were  social  drinkers  and  did  not  differentiate 
between  heavy  or  light  drinkers.  It  is  the  intent  of  this  pro¬ 
curement  to  determine  if  there  is  a  difference  between  heavy 
versus  light  drinkers  in  their  driving  performance  level  and  if 
there  is  a  interaction  between  drinker  type  and  alcohol  dosage 
level." 

NHTSA' s  basic  objective*  in  this  ongoing  program  are:  l)  to  determine,  via 
laboratory  driving  tests,  the  primary  causes  of  deterioration  in  driver  per¬ 
formance  under  alcohol;  and  2)  to  reveal  performance  indicators  which  might 
be  used  to  differentiate  "light"  or  "heavy"  drinkers  from  the  standpoint  of 
applying  selective  countermeasures,  and  for  revealing  the  most  effective 
avenues  for  reducing  the  risk  of  subsequent  crashes.  The  *pecific  purpose 
of  this  investigation  was  to  determine,  via  a  simplified  but  relevant  driving 
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simulation,  if  there  is  a  difference  in  driving  performance  on  the  basis  of 
an  individual's  drinking  habits  (Ref.  l).  By  using  a  simplified  set  of  tests 
relevant  to  driving  behavior,  the  task  variables  could  be  readily  controlled, 
and  the  detailed  characteristics  of  heavily  drunk  drivers  could  be  safely 
and  efficiently  measured.  The  most  promising  of  these  tests  and  possible 
countermeasures  could  later  be  validated  in  the  more  risky  (and  expensive ) 
field  trials. 


Research  Approach 

A  relatively  simple,  fixed-base  laboratory  driving  simulator  and  tasks 
and  measures  to  test  driving  performance  are  described  in  detail  in  a  companion 
paper  (Ref.  6),  which  also  presents  some  basic  effects  of  Blood  Alcohol  Concen¬ 
tration  (BAC)*  and  effects  of  divided  attention,  as  noted  below.  Without 
repeating  unnecessary  details,  we  will  comnent  here  on  the  key  considerations 
and  features  of  our  approach. 

Drunk  driving  accidents  usually  occur  at  night,  on  ‘'rural  (non -urban) 
streets,  and  involve  one  car  driven  into  a  collision  (usually  out  of  the  lane) 
by  a  male  driver  (Refs.  4  and  5).  The  relevant  driving  tasks  are  of  two  general 
types  operating  in  parallel:  continuous  oontrol  talk!  (steering  and  speed) 
which  intrinsically  involve  closed-loop  operation  of  the  car  and  driver  (Ref.  6) 
and  dlaorat*  taikl  (e.g.,  brakes,  horn,  turn  signals)  which  require  responses 
to  stimuli  detected  (often  peripherally),  recognized  (usually  by  a  visual  scan), 
and  responded  to  (in  a  practiced  movement)  all  in  an  '^open-loop"  manner.  When 
both  types  of  task  must  be  performed  concurrently  performance  on  one  type  can 
be  affected  by  interference  from  the  other  due  to  divided  attention.  It  was 
hypothesized  that  alcohol  might  more  adversely  affect  performance  on  combined 
steering-plus-discrete  driving  tasks  than  either  one  alone.  The  overall  experi¬ 
mental  plan  tested  this  hypothesis,  and  the  results  are  reported  in  the  com¬ 
panion  paper  (Ref.  6).  For  simplicity,  and  because  they  represent  the  more 


* Blood  alcohol  concentration  is  given  here,  as  customary,  in  grams  ethanol 
per  100  ml  blood,  which  approximates  the  volume  percentage  of  ethanol  in 
blood  (whose  specific  gravity  is  about  1.05)(Ref.  ^) •  The  blood  levels  are 
inferred  from  measurement  of  breath  alcohol  concentration,  for  which  the  term 
"BAC"  is  used  interchangeably. 


realistic  situation,  only  results  for  combined  steering-plus-discrete  tasks 
will  be  reported  here. 

Great  care  was  expended  on  selection  of  a  representative  sample  of  sub¬ 
jects.  Because  the  selection,  training,  drinking  sessions,  high  BAC  and 
placebo  sessions  were  very  costly  per  subject,  the  sample  was  limited  to  a 
total  of  twenty  finalists  (ten  in  each  drinking  category)  from  a  set  of  some 
50-80  "promising"  candidates.  We  found  that  most  "light"  drinkers*  could 
not  reach  the  desired  typical  "legal  limit"  levels  of  0.10  BAC  without  getting 
sick  (under  our  somewhat  intensive  drinking  regimen) .  Consequently,  we  had 
to  raise  the  "light"  category  to  "moderate"  drinkers*,  trying  to  find  the 
lightest  drinkers  among  those  who  would  not  get  sick  at  0.11  BAC.  "Heavy" 
drinkers*  were  easy  to  find  among  the  young,  but  were  surprisingly  hard  to 
obtain  in  older  ages,  because  we  did  not  wish  to  test  serious  problem  drinkers 
or  alcoholics  under  rehabilitation.  Various  drinking  habit  questionnaires 
proved  unreliable  indicators  of  true  alcohol  capacity,  so  we  conducted  "screen 
ing  drinking  sessions"  for  the  majority  of  candidates  in  order  to  verify  and 
calibrate  their  alcohol  capacity  prior  to  more  expensive  training  and  test 
sessions. 

These  efforts  to  select  subjects  were  further  complicated  by  an  effort 
to  have  in  each  drinking  habit  group:  1 )  a  demographically  representative 
and  balanced  spread  of  agesj  2)  an  average  range  of  IQ  and  educational  and 
driving  experience;  and  3)  mostly  male  subjects  (because  females  comprise  only 
a  few  percent  of  the  drunk  driver  fatalities,  e.g.,  Ref.  5).  These  criteria 
were  fairly  well  met. 

The  overall  experiment  was  divided  into  two  sets.  The  "main"  experiment 
carried  both  Moderate  and  Heavy  drinkers  to  a  peak  BAC  =  0.11,  just  over  the 
legal  limit,  and  an  extra  "high  BAC"  session  was  run  separately  for  the  Heavy 


*The  type  of  drinker  is  defined  here  in  terms  of  level  of  BAC  reached  in 
a  typical  drinking  session: 

Light:  BAC  rarely  exceeds  O.O5. 

Moderate:  BAC  usually  exceeds  O.O5,  may  occasionally  exceed 
0.10,  unlikely  to  ever  reach  O.15. 

BAC  usually  exceeds  0.10,  and  at  least  occasionally 
exceeds  O.15. 


Heavy: 


drinkers  to  take  them  toward  their  customary  limits  near  BAC  =  0 . 1 6+,  with 
stops  at  BAC  =0.11  to  tie  in  with  the  main  experiment .  The  idea  here  was 
to  compare  Moderate  and  Heavy  drinkers  not  only  at  the  s *06  ( supra-legal) 

BAC,  hut  also  near  etch  group's  customary  limit.  This  plan  was  successfully 
accomplished  with  interesting  results,  as  will  be  shown  later. 

Previous  experience  with  placebo  sessions  for  each  subject  (Ref.  7)  had 
shown  little  effect  of  time  of  day  or  fatigue,  so  we  were  reluctant  to  waste 
previous  test  time  on  non-drinking  runs.  Nevertheless,  to  establish  similar 
placebo  insensitivity  of  the  current  test  battery,  a  partial  set  of  single¬ 
blind  placebo  runs  was  made,  with  one  subject  per  session  having  the  placebo 
drinks  to  retain  all  of  the  social  factors  affecting  performance  through  the 
session. 

With  this  overview  of  our  approach  and  rationale  in  mind,  we  will  next 
briefly  describe  the  subjects,  apparatus,  tests,  measures,  experimental 
design,  and  procedures. 

EXPERIMENT  SETUP,  DESIGN  AND  PROCEDURES 
Subjects 

As  explained  in  the  Introduction,  ten  subjects  in  each  drinking  category 
were  finally  selected  so  as  to  achieve  a  demographically  representative  sample 
of  mostly  male  licensed  drivers  of  all  ages,  average  intelligence,  and  average 
driving  experience.  (Data  from  one  subject  in  each  group  in  the  main  experi¬ 
ment  and  for  two  subjects  in  the  high-BAC  sessions  were  unusable.)  Salient 
characteristics  of  the  subjects  are  given  in  Table  1 . 

As  a  result  of  screening  for  drinking  capability  in  a  group  drinking 
session,  approximately  50  percent  of  the  candidates  failed  to  qualify  for 
formal  experiments.  For  the  majority  of  those  who  did  qualify,  good  calibra¬ 
tions  of  BAC  vs.  ethanol  per  drink  were  obtained,  so  it  was  possible  to  achieve 
fairly  close  levels  of  BAC  for  each  subject  in  the  final  experiment.  Even 
though  we  attempted  to  provide  a  multi -subject  social  ambience  in  an  apartment¬ 
like  living  room,  the  drinking  regimen  was  somewhat  more  intense,  and  the  test 
atmosphere  was  somewhat  more  "tense"  than  a  typical  social  drinking  experience. 


TABLE  1.  DATA  ON  TEST  SUBJECTS 


a.  "Moderate"  Drinkers  (Frequently  to  .05+  BAC,  occasionally  to  .10  BAC) 


SUBJECT* 

AGE 

yrs 

WEIGHT 

kgn 

EDUCATION 

LEVEL* 

DRIVING 

EXPERIENCE 

(yrs) 

OCCUPATION 

H 

21 

84 

HS 

7 

(Unemployed) 

J 

22 

76 

Coll 

6 

Student 

U 

25 

84 

Coll 

9 

Mortuary  salesman 

R 

52 

67 

Coll 

16 

Photographer 

X 

57 

79 

Coll 

22 

Data  processing  supervisor 

Df 

45 

55 

Coll 

26 

Homemaker 

? 

47 

66 

HS 

28 

Maintenance  supervisor 

V 

47 

77 

HS 

25 

Real  estate  salesman 

S 

52 

88 

Coll 

40 

Driving  instructor 

N 

65 

82 

HS 

50 

(Retired) 

b.  "Heavy"  Drinkers  (Frequently  exceed  .10  BAC;  often  to  .15+  BAC) 


SUBJECT* 

AGE 

yrs 

WEIGHT 

kgm 

EDUCATION 

LEVEL* 

DRIVING 

EXPERIENCE 

(yrs) 

OCCUPATION 

C 

22 

62 

HS 

6 

Messenger  ! 

B 

22 

85 

Coll 

8 

Student 

A 

25 

74 

HS 

7 

(Unemployed) 

E 

28 

80 

Coll 

11 

Student 

K 

57 

82 

HS 

20 

Truck  driver 

M 

57 

78 

HS 

20 

Auto  salesman 

% 

42 

79 

HS 

24 

Auto  salesman 

W 

42 

98 

Coll 

27 

Bar  owner 

* 

54 

75 

HS 

56 

Insurance  agent 

T 

58 

91 

Coll 

45 

Realtor  (retired) 

#  f 

(  )  denotes  female  subjects;  (/)  denotes  formal  test  data  incomplete 
*HS  =  High  School;  Coll  =  College 
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Perhaps  because  of  this,  subjects  reported  somewhat  more  than  usual  likeli¬ 
hood  of  feeling  nauseated  at  their  maximum  BAC's. 

Subjects  were  trained  in  the  driving  simulator  for  two  half-day  sessions 
in  which  they  alternated  runs  with  another  subject.  The  simulated  scenario 
was  driving  at  30  tnph  on  a  rural  road  at  night  in  stormy  weather  —  a  diffi¬ 
cult  task  at  best  —  yet  the  subjects  readily  adapted  to  both  the  control 
and  discrete  tasks  because  they  were  based  on  well -practiced  'iving  reflexes. 
The  noticeable  lack  of  motion  cues  was  offset  by  a  realistic  (actual)  car 
interior  and  controls,  correct  vehicle  response  dynamics,  and  a  large-field- 
of-view  moving  roadway  perspective.  Consequently,  the  training  required  was 
similar  to  that  required  for  any  new  car.  All  subjects  accepted  the  simulator 
as  a  plausible  approximation  to  a  real  car  driving  situation,  and  they  pro¬ 
duced  behavior  typical  of  actual  car  driving.  (These  attributes  have  been 
notably  lacking  in  many  earlier  laboratory  investigations  of  alcohol  effects 
on  driving. ) 

Subjects  were  motivated  by  an  incentive  pay  formula  which  included:  a 
base  hourly  rate  through  training  and  formal  sessions;  and  a  "get  home*1  reward 
per  run  completion,  which  was  increased  with  RAC.  Approximately  $4 /hour  was 
earned,  on  the  average. 


Apparatus 

As  noted  earlier  an  appropriate  scenario  for  drunk  driving  accidents  is 
night  driving  on  a  rural  road  in  stormy  weather,  which  our  tasks  simulated 
(see  Fig.  l).  Reference  6  gives  further  details.  The  driver  sat  in  an  actual 
car  cab  with  realistic  steering,  accelerator,  brake,  and  turn  signal  controls. 
The  road  display  was  a  slightly  shrunken  (0.6  scale)  view  over  the  car's  hood 
towards  a  one -lane  straight  road  fading  into  the  distance.  The  dynamic  per¬ 
spective  was  drawn  on  a  25  cm  (10  inch)  CRT  60  cm  from  the  subject's  eyes  at 
a  refresh  rate  of  60  Hz,  so  that  no  blur,  flicker,  or  Jerk  were  apparent. 

Peripheral,  lightable  "signs"  were  placed  at  the  side  and  overhead  rear¬ 
view  mirror  locations  (±4-5  deg,  respectively)  and  at  ±20  deg  alongside  the  CRT 
(corresponding  to  signs  or  events  adjacent  to  the  car  lane  ahead  on  the  road). 
These  signs  had  small  4-letter  words  (i.e.,  [HORN],  [BRKE])  which  were  lit  by 
a  random  program  to  command  the  driver  to  respond  accordingly  (i.e.,  tap  the 
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BLOCK  DIAGRAM  OF  TASKS  AND  MEASURES 


horn  ring  or  brake  pedal).  The  letters  were  small  enough  (10  mm)  and  dimly- 
lit  so  as  to  be  just  detectable  parafoveally  when  turned  on,  but  to  require 
a  fixation  (scan)  to  read  the  discrete  command.  The  two  peripheral  signs 
were  adjusted  brighter  than  the  central  pair  to  compensate  for  the  cosine 
falloff  of  pupil  aperture,  thereby  starting  with  uniform  datectability 
across  all  lights  at  sober  conditions  (Ref.  12). 

The  dynamic  response  of  the  car-and-roadway  perspective  to  steering  con¬ 
trol  was  simulated  on  an  analog  computer  by  two-degree-of- freedom  (heading 
and  lateral  path  displacement)  equations  of  motions,  set  for  a  constant  speed 
of  30  mph  (50  km /'hr).  (Preliminary  tests  had  shown  that  60  mph  was  undrivable 
when  intoxicated.)  Unseen  gust  disturbances  were  simulated  by  a  sum-of-five- 
sinusoids  random  forcing  function.  The  task  was  subjectively  like  driving 
in  strong  crosswinds  and  was  scored  over  a  100  sec  period.  Special  analog 
and  data  logging  equipment  was  developed  to  provide  efficient  on-line  data 
reduction  of  path  and  heading  errors,  control  activity,  driver  describing 
functions  and  spectra,  and  steering  reversals.  See  Ref.  6  for  details. 

A  sequence  of  1 6  discrete  sign  -  Tnands  was  provided  (4  each  at  4  loca¬ 
tions),  ranging  from  1-5  sec  apart,  wruh  a  3  sec  criterion  for  response  time 
limit.  The  taped  program  was  changed  frequently  to  prevent  learning  of  the 
pattern  of  events.  A  special  Digital  Logic  Unit  was  developed  for  the  dis¬ 
crete  tasks  to  handle:  programming,  light  operation,  response  scoring  logic 
(misses,  corrects,  and  response  times),  and  date  logging. 

The  highly  compressed  on-line  data  (roughly  30  numbers  per  run)  were 
analyzed  off-line  by  a  previously  developed  STI  program  to  yield  a  comprehen¬ 
sive  array  of  performance  and  behavioral  parameters  such  as:  rms  steering 
wheel  activity,  j  rms  heading  error,  rms  path  error,  Oy)  crossover 
model  fit  parameters  for  the  car/driver  describing  function,  cjdc,  u^,  cp^,  xe 
(see  Refs.  6  and  8)j  various  open-  and  closed-loop  describing  functions,  Yp(jcn) 
spectra,  and  signal  coherences,  p2  (remnant  noise  effects).  This  program  also 
computes  a  number  of  discrete  task  measures  such  as:  Detection  Index,  %/F 
(fraction  of  signs  responded  to);  Recognition  Index,  Nq/Nj^  (fraction  of  non- 
missed  responses  which  are  correct )j  Response  Time,  Tr  (from  onset  of  sign  to 
completion  of  response).  The  discrete  task  measures  are  computed  for  each 


location  and  for  various  combinations,  but  only  the  overall  averages  are 
considered  here  because  the  peripheral  and  central  pairs  gave  similar 
results. 

For  a  number  of  runs,  the  STI  Model  EPR-2  Eye-Point-of-Regard  System 
(Ref.  13)  was  used  to  monitor  and  tape  record  the  driver's  scanning  behavior. 
This  was  the  first  known  application  of  this  device  to  a  highly  intoxicated 
human  operator,  but  it  worked  surprisingly  well  and  excellent  data  were 
recorded  on  3  out  of  4  subjects  so  instrumented. 

Blood  alcohol  concentration  was  inferred  from  breath  alcohol  concentra¬ 
tion,  measured  with  an  Intoximeters,  Inc.,  Mark  II  Gas  Chromatograph  Intoxi- 
meter,  which  was  calibrated  daily  against  reference  samples  of  0.10  and 
O.15  BAC.  A  minimum  wait  period  of  15  minutes  from  the  last  drink  was  allowed 
for  residual  mouth  alcohol  to  dissipate.  The  average  of  before-  and  after¬ 
run  BAC's  was  used. 

EXPERIMENTAL  DESIGN 

The  rationale  for  the  experimental  design  has  been  given  in  the  Intro¬ 
duction.  To  meet  the  basic  objectives,  the  main  experiment  contrasted  the 
Moderate  vs.  Heavy  drinkers  at  three  equal  levels  of  BAC  up  to  just  over 
the  legal  limit  (0,  =  0.0 6  BAC  ascending,  A  0.11  BAC  maximum,  =  0.0 6  BAC 
descending).  A  high-BAC  session  was  given  additionally  to  the  heavy  drinkers 
(0,  =0.11  BAC  ascending,  =  0.1 6  BAC  maximum,  =0.11  BAC  descending)  to  permit 
comparisons  of  alcohol  effects  at  each  group's  maximum  BAC  (i.e.,  0.11  BAC 
for  Moderate  vs.  0.1 6  BAC  for  Heavy  drinkers). 

The  resulting  matrix  of  experimental  treatments  is  given  in  Fig.  2, 
along  with  a  summary  of  other  relevant  conditions  and  tests.  Each  of  the 
three  types  of  test  (Discrete,  Control,  and  Combined  Tasks)  was  given  at  each 
condition.  Because  the  Moderate  and  Heavy  groups  intrinsically  contain 
different  people,  the  experimental  design  confounds  Subjects  with  Drinking 
Habits,  making  it  a  nested  design. 

Unless  a  subject  specifically  requested  otherwise  (as  did  a  few  heavy 
whiskey  drinkers),  the  standard  drink  was  80  proof  vodka  in  orange  juice  for 
a  roughly  20  percent  ethanol  drink,  heavy  in  fructose  for  optimum  absorption 
and  elimination. 


Discrete 

Task 

Alone 


TABLE  2.  EXPERIMENTAL  PROTOCOLS 


Session  A.  Orientation  and  Initial  Training  (4  hr) 

•  (Initial  encounter)  General  briefing  on  overall  program  task 
description  and  instructions,  first  trials  of  test  battery 

•  2-5  additional  rounds  of  test  battery  (control  task  only, 
discrete  task  only,  and  combined  task) 

Session  B.  Training  (4  hr) 

•  Review  task  and  instructions 

•  3-4  repeat  t-.’als  of  test  battery,  until  asymptotic 

Sessions  C,  D,  or  E.  Formal  Experimental  Session;  Placebo,  Drunk  or 
High  Drunk  (8  hr) 

•  If  AM,  give  light  breakfast  (toast  and  juice);  if  PM  wait  2-3  hr 
from  lunch 

•  Intoximeter  check  for  0  BAC 

•  Sober  Warmup  and  Baseline  runs  —  battery  of  driving*  and  clinical 
sobriety*  tests 

•  Imbibe  2  vodka  and  orange  juice  drinks  in  1-1 /2  hr,  alcohol  quantity 
adjusted  for  body  weight  to  give  "Ascending"  BAC  level  (0.06  for 
Main  and  0.11  for  Heavy  Drinking  Sessions) 

•  One  Placebo*  subject  per  session  of  3-4  subjects 

•  Ascending  BAC  runs:  driving  (O.O&t-  for  Main  and  0.11+  for  Heavy 
Sessions)  and  sobriety  tests  plus  subjective  questions8  and 
Intoximeter  BAC 

•  Third  drink,  adjusted  to  give  Maximum  BAC  level 

•  Peak  BAC  driving  and  sobriety  runs:  BAC  =0.11  for  main  and 
0 . 1 6  for  Heavy  sessions;  tests  as  above 

•  Light  lunch  or  supper 

•  Descending  BAC  runs:  at  same  BAC  as  Ascending  tests 


*Driving  tests:  Steering  Task  alone.  Discrete  Task  alone.  Combined  Tasks 
given  in  random  order. 

^Clinical  sobriety  tests:  walking  heel-to-toe;  Rhomberg  test  (balance); 
positional  nystagmus  at  periphery  (PAN-1 ). 

fPlacebo  drink:  15  ml  vodka  floated  on -diluted  ©range  juice  mixer. 

•Subjective  questions:  level  of  intoxication;  capability  of  driving; 
degree  of  r.ausea  and  vertigo. 
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PROCEDURES 


The  protocols  and  sequencing  of  tests  in  each  type  of  session  are 
summarized  in  Table  2.  Details  of  the  drink  administration  and  resulting 
BAC  vs.  time  data  are  given  in  Ref.  6.  Placebo  drinks  had  1 5  ml  of  vodka 
floated  on  the  watered-down  mixer  to  delay  awareness  of  a  non-intoxicating 
drink.  During  the  Formal  Experimental  Sessions,  from  2-4  subjects  were 
present  to  lend  a  more  sociable  air  to  the  drinking  (when  there  were  only 
2  subjects  an  experimenter  often  joined  their  group  conversationally) . 

Despite  every  effort  to  prevent  sickness  (and  the  resulting  loss  of  key 
data,  as  well  as  subject  cooperation),  a  few  cases  did  occur  and  some  data 
cells  are  thereby  missing  on  a  few  subjects. 

RESULTS  AND  DISCUSSION 

As  noted  in  the  Introduction,  even  though  Control  and  Discrete  Tasks 
were  given  along  with  the  combined  task,  the  present  paper  only  discusses 
the  combined  task  results,  which  are  the  most  relevant  for  revealing  differ¬ 
ences  between  Medium  and  Heavy  drinkers.  Reference  6  analyzed  the  effects  of 
separate  vs.  combined  tasks  in  detail,  for  the  main  experiment  only.  The  key 
results  of  that  analysis  apropos  of  our  work  are  as  follows: 

•  The  discrete  task  interferes  with  the  driving  task  when 
performed  concurrently,  the  interference  always  being 
detrimental  but  small  and  causing  differences  in  degree 
rather  than  kind  of  behavior. 

•  For  most  measures,  the  sensitivity  to  alcohol  level  is 
roughly  parallel  between  driving  tasks  done  singly  vs. 
combined.  Path  deviations  are  more  sensitive  to  BAC 
under  combined  tasks. 

•  Differences  among  placebo  runs  are  not  large  or  signi¬ 
ficant,  meaning  that  time  of  day  effects  can  be  ignored. 

•  Ascending  and  descending  BAC  runs  yield  similar  data  at 
comparable  BAC  levels,  thus  either  can  be  used. 

So,  we  will  consider  only  the  combined  control  and  discrete  task  data  in 
this  section.  However,  to  simplify  the  presentation,  the  relatively  straight¬ 
forward  discrete  task  results  will  be  discussed  first,  saving  the  more  complex 
control  task  results  for  last. 
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Before  proceeding  to  the  reduced  data,  let  us  first  examine  selected 
signals  in  a  pair  of  time  histories  of  tracking  runs,  sober  and  drunk  (see 
Fig.  5).  Points  worth  noting  are  as  follows,  starting  at  the  top: 

•  The  eye-point-of-regard  fixations  show  that  even  when 
drunk  the  subject  detects  nearly  all  of  the  peripheral 
light  onsets  (as  evidenced  by  a  scan);  however,  seme 
of  the  required  raaponaes  are  simply  ignored. 

w  Once  detected,  the  response  is  usually  accurate,  imply¬ 
ing  near-perfect  recognition  of  the  "sign"  details. 

•  There  are  more  blinks  (b)  sober  than  drunk. 

•  Longer  scan  latencies  and  dwells  are  seen  at  the  high 
BAC  condition,  as  well  as  some  spurious  scans. 

•  The  steering  and  path  errors  both  increase  at  high  BAC, 
with  some  steering  traces  showing  more  "holds"  than  at 
sober  conditions. 

•  The  increased  path  error  at  high  BAC  is  more  of  a  wander¬ 
ing  than  oscillatory  type,  implying  a  looser  steering 
control  loop  rather  than  any  approach  to  oscillatory 
instability.  (However,  a  few  subjects  showed  occasional 
"weaving"  of  a  neutral  damped  type.) 

The  parameters  selected  for  analysis  clearly  reflect  these  qualitative 
observations. 

Analyaia  of  Variance 

Before  proceeding  to  the  discussion  of  specific  results,  a  summary  is 
presented  of  an  Analysis  of  Variance  for  the  main  experiment  which  covers 
Moderate  vs.  Heavy  drinkers  at  alcohol  levels  up  to  the  legal  limit 
(BAC  =  0,  0.06,  0.11;  Moderate  vs.  Heavy  drinkers  with  nine  subjects  per 
group).  A  partially- nested  design  was  employed  because  a  different  set  of 
subjects  was  necessary  for  the  Moderate  and  Heavy  drinking  categories; 
otherwise  there  were  full- factorial  combinations  of  habit  and  BAC  level, 
with  nine  subjects  and  one  observation  per  cell.  Subjects  were  considered 
a  random  variable,  and  Type  of  Drinker  and  BAC  were  included  as  fixed 
effects.  Subjects  were  used  as  a  systematic  random  variable  in  the  ANOV 
so  as  to  separate  out  any  stratification  in  their  own  skill  levels  from 
the  other  sources  under  investigation  (in  effect,  using  each  subject  as  his 
own  experimental  control ) . 


TIME  TRACES  OF  TYPICAL  SOBER  AND  DRUNK 
DRIVING  BEHAVIOR  IN  THE  SIMULATOR 


A  summary  of  the  resulting  F-ratios  for  key  measures  of  steering  and 
discrete  tasks,  and  their  statistical  reliability  is  given  in  Table  3. 

Taken  across  the  board,  this  ANOV  tells  the  following: 

•  'The  effects  of  BAC  on  both  types  of  drinker  are 
large  and  very  reliable  statistically. 

•  Averaged  across  all  BAC  up  to  legal  limits, 
differences  between  the  two  drinker  types are 
not  statistically  reliable. 

•  There  are  a  number  of  parameters  for  which  the 
effect  of  BAC  was  reliably  different  for  the 
Moderate  vs.  Heavy  drinkers. 

Other  implications  of  the  ANOV  will  be  used  in  the  subsequent  discussions. 

Discrete  Tasks 

Key  results  from  the  discrete  tasks  are  presented  in  Fig.  4,  as  a  function 
of  BAC  for  Moderate  vs.  Heavy  drinkers  in  the  main  experiment  and  for  Heavy 
drinkers  in  the  high-BAC  session.  Cursory  examinations  of  the  data  from  cen¬ 
tral  (±20  deg)  vs.  peripheral  (±45  deg)  locations  showed  only  small  differ¬ 
ences,  probably  because  the  sober  detectability  was  equalized  for  all  angles. 
Thus,  we  will  consider  only  the  averaged  data  from  all  sign  locations.  Also, 
note  that  each  pair  of  Heavy  points  near  BAC  =0.11  lie  close  together, 
implying  consistent  behavior  at  a  given  EAC,  because  these  data  were  measured 
in  different  sessions  several  days  apart. 

It  is  apparent  that  alcohol  level  does  not  impair  discrete  task  perfor¬ 
mance  as  much  as  might  be  expected  (though  the  impairment  is  very  reliable, 
statistically),  and  that  Moderate  and  Heavy  drinkers  appear  to  have  different 
trends  with  BAC  (although  only  "possibly  significant"  statistically).  At  BAC 
near  legal  limits,  the  Detection  Index*,  Nj/N  (fraction  of  signs  responded  to 
within  *  seconds)  shown  in  Fig.  4a,  decreases  about  20  percent  for  Moderates  but 
negligibly  for  Heavies  (this  difference  is  possibly  reliable;  t'  =  1 .4  at  8  df, 
a  =  0.1 ).  However,  near  their  oustomary  limits  (Moderate  at  0.11  BAC  vs.  Heavy 


•ft 

In  view  of  the  evidence  of  peripheral  detections  from  scanning  data,  %/N 
might  more  correctly  be  called  the  "Response  Fraction." 
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Figure  4 

DISCRETE  TASK  PERFORMANCE  VS  BAC  AND  HABITS 


at  0.1 6  BAC),  the  Heavy  drinkers*  performance  deteriorates  to  a  slightly 
worse  degree  than  does  that  of  Moderate  drinkers  (not  statistically  reliable; 
t'  =  0.6,  8  df;  a  >  0.1 ). 

The  "Recognition  Index,"  Nc/Np  (fraction  correct  of  those  not  missed,,, 
shown  in  Fig.  4b,  remains  within  a  few  percent  of  1.00  for  Moderate  or  Heavy 
drinkers  up  to  MC  =  0.11,  beyond  which  the  Heavy  drinkers  show  a  small 
(6  percent)  deterioration.  This  somewhat  surprising  result  is  consistent 
with  the  eye-point-of-regard  data  (discussed  in  connection  with  Fig.  3)-  Our 
interpretation  is  that  most  BAC-caused  misses  are  due  neither  to  lack  of 
peripheral  detection  (all  signs  are  fixated)  nor  to  poor  pattern  recognition 
(because  Nc/Np  =  1.0);  therefore,  they  must  be  due  to  the  driver  being  exces¬ 
sively  late,  or  even  omitting  the  motor  response  —  another  manifestation  of 
an  "indifference  threshold"  effect  noted  in  Ref.  6  and  later  herein. 

This  interpretation  finds  support  in  the  Response  Time  date  of  Fig.  4c, 
where  at  legal  limit  BAC's,  the  Moderate  drinkers  show  a  20  percent  and  the 
Heavy  drinkers  a  12  percent  increase.  Nearer  their  limit  (BAC  =  0.16)  tu.’> 
Heavy  drinkers  show  a  35  percent  increase  over  their  sober  response  time 
levels.  As  noted  for  the  Detection  Index,  the  response  times  of  Heavy 
drinkers  are  impaired  less  than  Moderates  at  near-legal  limit  BAC’s,  but 
are  more  impaired  at  BAC’s  nearer  their  drinking  limits. 

As  the  average  response  times  increase  from  around  1.3  sec  near  0  BAC 
to  1.5-1. 8  sec  at  higher  BAC’s,  some  misses  (Tr>3.0  sec)  will  be  expected 
from  the  longer-time  "tails"  of  the  Tp  distributions,  even  though  recogni¬ 
tion  remains  nearly  perfect.  The  trends  in  the  M  vs.  H  data  f  jt  Np/N  and 
Tp  in  Fig.  4  are  consistent  with  this  explanation  below  0.11  BAC,  and  should 
be  further  investigated  using  eye-point-of-regard  data.  As  a  tie-in  with 
other  related  data,  the  open  crosses  in  Fig.  4c  are  the  response  times  from 
a  roughly  similar  experiment  conducted  recently  by  H,  Moskowitz  at  the  UCLA 
Insitute  of  Traffic  Engineering  (Ref.  9)»  (In  that  experiment  the  subject, 
in  a  driving  simulator,  was  asked  to  respond  to  a  pair  of  colored  lights 
mounted  on  the  sun  visor  at  ±15  deg  off  center  by  pressing  up  or  down  on 
one  of  a  pair  of  turn-indicator-like  switches.)  Although  the  levels  differ 
slightly,  the  trend  with  BAC  is  quite  similar  and  indicates  that  our  data 
are  compatible  with  that  from  other  investigators. 
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Steering  Tasks 


Performance  Measures.  Figure  5  presents  the  most  important  measures 
of  overall  steering  task  performance.  Although  the  plots  progress  from 
the  inner  to  outer  loops  (steering,  heading,  path),  it  is  more  instructive 
to  consider  them  in  reversed  order.  Just  as  for  the  discrete  task  data, 
the  tie-in  at  the  two  Heavy  drinker  sessions  near  O.n  BAC  is  excellent, 
indicating  reliable  data  for  the  steering  tasks. 

Considering  the  path  deviations  of  Fig.  5c  first,  it  is  apparent  that 
alcohol  seriously  impairs  the  control  performance  of  both  Moderate  and 
Heavy  drinkers  (ANOV:  a  <  0.001 ).  Furthermore,  over  the  0-0.11  BAC  range, 
the  differential  effects  of  alcohol  on  Moderate  vs.  Heavy  drinkers  are 
statistically  reliable  (a  <  O.O5). 

On  the  right  of  Fi,;.  5c  is  noted  the  probability  (computed  on  the  basis 
of  a  Gaussian  path-error  distribution)  that  at  any  given  time  some  portion 
of  a  standard  size  car  80  in.  =  an  width  may  exceed  a  12  ft  (2.7  m)  lane 
width.  It  is  apparent  that  sober  drivers  will  stay  well  within  their  lane, 
but  drunk  drivers  may  not.  For  Heavy  drinkers  this  chance  of  lane  exceedance 
goes  from  around  1  in  10,000  when  sober  to  1  in  100  near  legal- limit  BAC 
(0.11),  and  to  1  in  10  near  their  maximum  levels  (0.1 6  BAC).  For  Moderate 
drinkers  the  chance  of  lane  e>  ceedance  grows  more  rapidly;  from  less  than 
1  in  10,000  when  sober  to  around  1  in  20  when  near  legal  limit  (O.n  BAC). 
From  another  point  of  view,  ihese  results  imply  that,  at  near- legal  limits 
of  alcohol  (0.11  BAC),  experienced  Heavy  drinkers  have  on  the  order  of  one- 
fifth  the  lane  exceedances  as  Moderate  drinkers;  but  at  levels  of  alcohol 
near  each  group's  likely  (nausea)  limits  the  Heavy  drinkers  will  have  twice 
the  number  of  lane  exceedances  of  Moderate  drinkers. 

The  heading  deviations  shown  in  Fig.  5b  also  increase  drastically  and 
reliably  with  BAC  (ANOV:  a  <  O.OOl).  Again,  Moderate  drinkers  show  more 
•ensitivity  to  BAC  than  Heavy  drinkers  (but  the  interaction  is  not  quite 
statistically  reliable),  and  here,  too.  Heavy  drinkers  perform  better  than 
Moderates  at  legal  levels  ~f  BAC  but  significantly  worse  than  Moderates  at 
more  customary  limits  (t'  =2.2,  8  df;  a  <  O.O5). 


Figure  5 


STEERING  PERFORMANCE  MEASURES  VS  BAG 


In  both  heading  and  path  control  the  Moderate  group  performed  slightly 
better  nober  than  the  Heavy  group.  This  difference  is  not  statistically 

significant  (t‘  <  1 .0,  a  >  0.10),  but  it  masks  any  overall  differences 
between  the  gtniral  performance  of  Moderate  vs.  Heavy  drinkers  at  BAC  <  0.06. 
It  was  observed  that  a  number  of  Heavy  drinkers  performed  better  (in  oy)  at 
0.06  BAC  than  when  sober.  (In  the  light  of  Figs.  4b  and  4c,  it  might  be 
more  correct  to  say  some  Heavy  drinkers  performed  slightly  worse  when  sober 
than  with  a  slight  amount  of  alcohol.)  This  would  tie  in  with  anecdotal 
observations  that  some  Heavy  drinkers  are  "nervous"  or  "jumpy"  when  sober, 
and  "calm  down"  at  mild  BAC  levels.  Detailed  data  on  each  individual  are 
available  to  follow  up  on  these  leads,  but  we  have  not  yet  done  so. 

Lastly,  consider  the  control  activity  performance  ofi  ,  given  in  Fig,  4a. 
If  the  driver  perfectly  cancelled  the  steering  disturbance  inputs,  his  score 
would  be  constant  at  =  5.2  degrees  of  steering  wheel  motion.  In  practice, 
he  can  cancel  out  low  frequency  disturbances  (i.e.,  frequencies  well  below 
the  unity- gain- cross over  frequency,  (x^),  but  will  lag  and  overshoot  his 
corrections  near  u\.,  and  will  attenuate  those  above  o^.  In  addition,  any 
spurious  steering  actions  such  as  "holds,"  "dither"  or  "limiting"  will  add 
remnant  noise  to  the  agg.  Since  so  many  factors  can  influence  oBs  it  serves 
mainly  as  an  indicator  of  seriously  excessive  corrections;  or  if  it  drops, 
it  indicates  that  the  driver  is  not  even  attempting  to  correct  most  dis¬ 
turbances,  and  is  in  effect  opening  the  heading  control  loop.  Our  results 
show  that  control  activity  always  exceeded  the  disturbance- cancelling  value, 
and  was  increased  on  the  order  of  20  percent  at  higher  BAC's.  As  before, 
the  Heavy  drinkers  show  less  sensitivity  tn  BAC  than  Moderate  drinkers  at 
legal-limit  levels,  and  comparable  sensitivity  at  maximum  BAC's. 

Figure  6  shows  additional  performance  measures  of  insightful  value. 

At  the  top  are  shown  the  coherence  data  for  steering  activity  and  heading. 
"Relative  remnant"  (the  fraction  of  noise  in  the  total  signal  power)  is 
measured  by  the  complement  of  the  coherence,  as  shown  on  the  righthand 
scales.  These  data  (with  the  ANOV  of  Table  3)  imply  that  alcohol  reliably 
increases  relative  steering  remnant,  but  only  at  levels  above  0.06  BAC  for 
Moderate  drinkers  and  above  0.11  BAC  for  Heavy  drinkers .  Overall,  the 
effects  of  BAC  on  coherence  are  smaller  than  one  might  expect  considering 


Figure  6 

CONTROL  COHERENCY  AND  STEERING 
REVERSAL  RATE  VS  BAC 
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the  more  nonlinear  appearance  of  the  time  traces.  Apparently,  this  is 
explained  by  the  fact  that  the  increased  remnant  mainly  reflects  a  con- 
s-t-orvt;  proportion  of  increased  linear  errors. 

We  recorded  steering  wheel  reversal  rate,  Nrev,  (presented  conventionally 
as  +  or  -  reversals  per  minute  for  small  reversals)  for  comparison  with  other 
investigators  who  use  this  measure  of  steering  activity  (e.g..  Refs.  9  and  10; 
and  these  are  shown  in  Fig.  6c.  There  is  not  much  variation  with  BAC  (note 
the  suppressed  origin  scale),  although  there  appears  to  be  a  slight  rise  in 
Nrftv  for  Heavy  drinkers  at  low  BAC.  (The  ANOV  implied  no  significant  effects 
of  BAC  on  Moderat  vs.  Heavy,  but  their  differences  *t  0.11  BAC  are  possioly 
reliable.)  Also  shown  is  the  nearest  input  frequency  (tui  =  6.28  rad/sec) 
which  might  possibly  influence  (stabilize)  the  steering  reversal  counts. 

As  a  matter  of  interest,  a  rough  estimate  of  the  closed  heading  loop 
frequency  was  made,  which  turns  out  to  be  around  =  3.5  rad/sec.  If  the 
damping  latio  is  low  (as  the  low  phase -margin  data  presented  later  implies), 
then  a  spectral  peak  due  to  circulating  remnant  would  occur  at  this  fre¬ 
quency,  and  it  might  give  rise  to  steering  reversal  rates  of  Nrev  =  65-7O  per 
minute,  just  in  the  range  observed!  This  possibility  is  worthy  of  further 
investigation  as  a  simple  indicator  of  car/driver  closed-loop  bandwidth. 

Drlvtr  Behavior  Pat*  (Describing  Functions).  As  noted  earlier,  several 
factors  can  influence  the  overall  measures  of  driver  control  performance, 
because  these  are  intrinsically  closed-loop  measures  wherein  the  output  char¬ 
acteristics  (e.g.,  path  error)  are  a  product  of  the  input  spectrum  and  level, 
the  car/driver  dynamics  (measured  via  the  frequency  response  describing  func¬ 
tions),  and  the  injected  remnant  (noise)  contributions  which  circulate  around 
the  heading  and  path  control  loops  (see  Ref.  8  for  the  complex  details).  An 
essential  ingredient  in  understanding  the  net  effects  of  alcohol  on  perfor¬ 
mance  is  its  effect  on  tne  driver's  describing  function,  Yp(jcu),  with  a 
realistic  roadway  dynamic  perspective  display  to  the  perceptual  system  and 
with  realistic  car  dynamic  response  properties  in  heading  and  path.  Such 
describing  function  measurements  have  been  made  for  every  run  and  they  clearly 
show  the  effects  of  alcohol.  Reference  6  presents  typical  examples  of  Yp(jco) 
averaged  over  numerous  subjects,  and  shows  that  a  few  key  parameters  suffice 


to  model  their  salient  features.  Some  findings  from  Ref.  6  relevant  to  this 
discussion  are  the  following: 

•  The  driver's  describing  function  can  represent  the 
sensitivity  to  both  heading  and  path  deviations,  these 
being  reflected  in  the  gains,  | Yp | ,  at,  respectively, 
high  {>  a\>)  or  low  (<  <jjc)  frequencies. 

•  Alcohol  causes  reductions  in  both  heading  and  path  gain, 
but  mostly  in  path  gain,  best  characterized  by  | Yp |  at 
0.19  rad/sec  and/or  0.5  rad/sec,  the  latter  being  more 
reliable . 

•  Alcohol  causes  only  small  changes  in  phase  lags  below 
or  near  because  decreases  in  neuromuscular  subsystem 
bandwidth  at  higher  freq  .encies  are  somewhat  offset  by 
their  lower  damping  ratio  (e.g.,  see  also  Ref.  l 1 ) .  As 
a  result,  the  180  deg  phase  crossover  frequency,  (%,  is 
a  better  indicator  than  effective  delay,  xe,  of  the 
reduction  in  maximum  driver  bandwidth  as  limited  by 
neuromuscular  delays. 

•  Alcohol  affects  stability  margins  (phase  or  gain  margins) 
surprisingly  little  when  averaged  across  all  types  of 
subjects. 

We  will  present  some  additional  describing  function  data  over  Ref.  6  to 
extend  these  findings  to  higher  BAC,  and  to  investigate  differences  between 
drinking  habits.  Figure  7  gives  the  describing  function  parameters  repre¬ 
senting  the  driver's:  bandwidths  (u^  ~  maximum  bandwidth}  cnc  ~  actual 
bandwidth  —  also  to  heading  deviation  sensitivity)}  stability  margin, 

(margin  in  phase  lag  relative  to  l80°  =  instability)}  and  path  error  sensi¬ 
tivity  (magnitude  of  Yp(joj)  at  0.19  and  O.5O  rad/sec). 

At  the  top  of  Fig.  7  the  bandwidths  and  a>c  both  show  a  monotonic 
reduction  with  BAC  which  is  very  reliable  statistically  (a  <  0.001,  Table  3). 
The  Heavy-drinker  data  show  that  this  trend  extends  to  0.1 6  BAC,  with  no 
sudden  dropoff  apparent.  In  fact,  somewhat  unexpectedly,  tends  to  level 
off  at  0.16  BAC,  implying  no  drastic  neuromuscular  impairment  at  heading 
control  frequencies.  Moderate  drivers  start  out  at  0  BAC  with  slightly 
better  bandwidths  which  decrease  with  BAC  faster  than  for  Heavy  drinkers. 

This  interaction  is  possibly  reliable  (a  <  0.1,  Table  3 ),  hut  the  bandwidths 
averaged  over  0-0.11  BAC  are  no  different  for  Moderate  and  Heavy  drinkers. 
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PARAMETERS  VS  BAC 
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Figure  7^  shows  that  the  stability  margins  (q^j)  for  Heavy  drinkers  fall 
off  very  slowly  with  alcohol,  while  those  for  Moderate  drinkers  actually  seem 
to  increase  slightly  up  to  0.11  BAC  (these  effects  are  not  statistically 
significant).  Since  the  gain  margin  (roughly  measured  by  the  ratio  of  o^/o^) 
is  slightly  reduced  for  O.n  BAC,  while  phase  remains  about  constant,  these 
gain  and  phase  margin  effects  reflect  a  more  conservative  control  strategy 
at  high  BAC. 

Finally,  the  path- sensitivity  data  at  the  bottom  of  Fig.  7  show  a  strong 
and  consistent  reduction  with  increasing  BAC,  the  reduction  relative  to  sober 
BAC  being  slightly  more  for  Moderate  than  Heavy  drinkers  (main  BAC  effect 
very  reliable,  a  <  O.OOlj  interaction  not  so,  per  Table  3).  Considering  the 
linear  ratio  scale  of  Fig.  7c,  it  is  apparent  that,  typically,  the  path  sensi¬ 
tivity  decreases,  from  100  percent  at  0  BAC  to  about  70  percent  at  0.11  BAC 
and  50  percent  at  O.16  BAC,  with  Heavy  drinkers  being  less  sensitive  than 
Moderates . 

An  hypothesis  is  proposed  in  Ref.  6  that  an  increase  of  the  driver's 
"indifference  threshold"  and/or  more  "intermittency  of  attention"*  could 
account  for  a  number  of  the  behavioral  and  performance  effects  of  alcohol 
(e.g.,  lower  gains,  small  phase  effects,  constant  stability  margins,  more 
remnant,  larger  errors  of  a  wandering  rather  than  oscillatory  type,  etc.). 

The  present  results  for  Heavy  drinkers  up  to  O.16  BAC  are  consistent  with 
the  Ref.  6  trends  and  support  the  same  conclusions.  Further,  the  observed 
relative  insensitivity  of  phase  lags  near  goq  and  decreased  control  coherency 
are  consistent  with  the  simple  compensatory  tracking  data  of  Ref.  1 1  at 
BAC  <  0.08. 

Taken  as  a  whole  our  results,  for  discrete-plus-control  tasks  which 
crudely  simulate  driving  on  rural  roads  at  night  in  stormy  weather,  show 


* Indifference  Threshold  =  thresholds  in  a  perceptual  motor  control  loop 
which  are  not  specifically  sensory  or  proprioceptive  thresholds,  e.g., 
control  inaction  while  the  error  is  within  some  tolerance  zone  (Ref.  14). 

*Attentional  Intermittency  =  switching  of  control  attention  frequently, 
and  usually  asynchronously,  from  task  to  task  (or  loop  to  loop),  often  (but 
not  always)  evidenced  by  eye-point- of-regard  or  control  inactivity  (e.g., 
Ref.  15). 
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reliably  increasing  impairment  of  driving  performance  and  skill  as  alcohol 
levels  reach  and  exceed  typical  legal  limits,  near  0.11  BAG .  Heavy  drinkers 
show  less  sensitivity  than  Moderate  drinkers  at  legal  limits  but  are  more 
impaired  than  Moderates  when  coinpared  near  each  group's  cusomary  drinking 
habits. 

SUMMARY  AND  CONCLUSIONS 


Summary 

A  simplified  laboratory  driving  simulator  was  developed  to  test  both 
types  of  tasks  used  in  driving  a  car  on  the  open  road:  a  continuous  compen¬ 
satory  "steering  task"  to  regulate  against  heading  and  path  deviations;  and 
an  intermittent  "discrete  response  task"  requiring  detection,  scanning, 
recognition,  and  response  (e.g.,  horn  and  brake  operations).  The  description 
of  this  simple  simulator,  with  an  investigation  of  the  basic  effects  of  alco¬ 
hol  up  to  0.11  BAC  for  18  subjects  under  different  task  loadings  (steering 
task  alone,  discrete  task  alone,  and  combined  tasks  requiring  divided  atten¬ 
tion),  is  given  in  a  companion  paper  (Ref.  6). 

The  objective  of  the  present  experiment,  which  formed  the  main  facet  of 
the  overall  investigation,  was  to  determine  if  there  is  a  difference  in 
driving  performance  (and  the  underlying  behavior)  on  the  basis  of  an  indivi¬ 
dual's  drinking  habits.  This  objective  was  successfully  met,  using  a  typical 
cross  section  of  20  licensed  drivers  who  drink  either  moderately  or  heavily. 
They  were  divided  into  two  drinking  habit  groups  of  10  each  (balanced  as  well 
as  feasible  for  representative  IQ  and  wide  age  range):  Moderate  drinkers 
(usually  exceeding  O.O5  BAC  and  occasionally  reaching  0.10+  BAC);  and  Heavy 
drinkers  (usually  exceeding  0.10  BAC  and  occasionally  exceeding  O.15+  BAC). 
Light  drinkers  (rarely  exceeding  O.O5  BAC)  could  not  be  tested  at  the  desir¬ 
able  legal  limit  level  of  0.10+  BAC  due  to  excessive  nausea.  The  main 
experiment  compared  Moderate  vs.  Heavy  drinkers  at  BAC  =  0,  0.06,  and  0.11; 
the  maximum  just  exceeds  a  common  legal  limit  of  BAC,  and  was  very  near  the 
maximum  limit  for  most  of  the  Moderate  drinkers  due  to  nausea  or  other 
reasons.  A  separate  session  took  the  Heavy  drinkers  to  0,  0.11,  and  0.1 6 
BAC,  the  maximum  being  near  their  customary  limit.  (Serious  problem  drinkers 
or  alcoholics  were  not  tested.)  Two  subjects  could  not  complete  their  runs. 


The  combined  (divided  attention)  task  analyzed  herein  included  steering 
control  against  random  disturbances,  plus  discrete  commands  (to  tap  the  horn 
or  brake)  appearing  randomly  on  small  peripheral  signs  at  locations  corre¬ 
sponding  to  the  road  edges  (±20  deg)  and  rear  view  mirror  ( ±15  deg).  The 
scenario  was  driving  a  rural  road  on  a  stormy  night.  Several  parameters 
were  measured  including:  heading,  path,  and  steering  deviations;  driver's 
describing  function  and  coherency;  and  discrete  task  detection  index,  recog¬ 
nition  index,  and  response  time.  Discrete  response  and  steering  signals 
were  recorded  for  all  runs,  plus  eye-point-of-regard  signals  for  selected 
subjects.  As  a  target  of  opportunity,  clinical  ratings  and  tests  of  sobriety 
were  also  logged,  but  these  have  not  yet  been  analyzed.  Generally  speaking, 
the  data  are  quite  repeatable  (e.g.,  same  group  on  separate  sessions),  are 
self-consistent  (e.g.,  within  tasks  and  drinking- habit  groups),  and  show 
some  effects  very  sensitive  to  BAC  and  to  type  of  drinker. 


Conduaiona 


The  major  conclusions  from  this  experiment  are  as  follows: 

•  At  sober  conditions  (including  one  set  of  placebo  runs 
during  each  session)  there  were  no  significant  differ¬ 
ences  between  the  Moderate  and  Heavy  drinkers.  The 
chance  of  lane  exceedance  by  some  part  of  the  car  is 
less  than  0.0001  for  both  groups  when  sober. 

•  Alcohol  levels  above  common  legal,  limits  (0.11  to 
0.1 6  BAC)  cause  very  appreciable  and  statistically 
reliable  Impairments  of  the  driving  performance  of 
both  Moderate  and  Heavy  drinkers,  in  particular  to: 
path  and  heading  deviations;  driver's  sensitivity  to 
errors  in  path  and  heading;  steering  remnant;  and 
discrete  task  misses  and  response  times.  Driver  con¬ 
trol  loop  stability  margins,  discrete  task  recogni¬ 
tion  accuracy,  and  steering  wheel  reversal  rate  are 
not  changed  significantly. 

•  Compared  at  legal  limit  alcohol  levels  (0.11  BAC), 
Heavy  drinkers  tend  to  be  less  impaired  in  the  above 
measures  than  Moderate  drinkers  (probability  of  lane 
exceedance  of  ©.01  vs.  0.05);  but  compared  near  their 
customary  drinking  limits  (0.11  BAC  for  Moderate  vs. 
0.1 6  BAC  for  Heavy  drinkers)  the  Heavy  drinkers  are 
usually  more  impaired  than  Moderate  drinkers  (chance 
of  lane  exceedance  of  0.10  vs.  0.05). 
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•  The  above  effects  could  be  explained  by  alcohol- 
induced  increases  in  the  driver's  "indifference 
threshold"  and/or  more  "attentional  intermittency 
plus  some  reduction  in  neuromuscular  bandwidth  at 
higher  BAC. 

•  Eye-point-of-regard  measurements  showed  that,  in 
these  reasonably  stressful,  combined  steering  and 
discrete  tasks,  the  driver  does  not  search  (scan) 
for  discrete  events;  rather  he  fixates  primarily 
on  the  road  ahead  and  detects  "interesting"  events 
peripherally,  then  fixates  the  event,  recognizes 
it  (usually  perfectly),  then  makes  the  required 
response  (sometimes  late  or  ignored  at  high  BAC). 

•  Peripheral  discrete  task  data  at  ±1+5  deg  were 
usually  within  10  percent  of  those  at  ±20  deg  at 
BAC  *  0.11,  partly  because  the  outer  sign  bright¬ 
ness  was  increased  for  equal  just-detectable  levels 
when  sober. 

•  The  rate  of  steering  wheel  reversals  corresponds 
roughly  to  the  car/driver' s  closed  heading  loop 
frequency  arid  follows  a  similar  small  decrease  at 
higher  BAC. 

•  The  response  time  and  describing  function  data  tie 
in  well  with  other  investigators'  results  on  similar 
setups . 
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Six  airline  pilots  participated  in  a  fixed  base  simulator  experiment 
designed  to  study  the  advantages  and  disadvantages  of  incorporating  a  simple 
horizontal  flight  path  predictor  on  both  fixed  and  rotating  electronic  CRT 
map  displays. 

The  pilots  were  asked  to  fly  a  modified  "figure  eight"  ground  track 
(similar  to  right  and  left  procedure  turns  in  sequence)  while  attempting  to 
maintain  constant  altitude.  The  dynamics  were  representative  of  a  transport 
aircraft.  All  flight  information  was  displayed  on  one  17-in.  (43-cm)  CRT 
monitor.  The  controlled  variables  were:  (1)  map  orientation;  (2)  pilots; 

(3)  presence  or  absence  of  crosswinds;  (4)  presence  or  absence  of  wind  gusts; 
(5)  presence  or  absence  of  predictor.  Error  scores  were  recorded  as  deviations 
from  the  commanded  ground  track  and  altitude. 

Pilot  comments  and  ratings  were  also  obtained.  No  interaction  in  per¬ 
formance  scores  was  found  between  the  predictor  and  the  two  different  map 
display  orientations.  It  was  found  that  the  predictor  reduced  deviations 
from  the  commanded  ground  track,  narrowed  performance  differences  among  pilots, 
narrowed  the  error  differences  found  with  and  without  crosswinds,  and  decreased 
pilot  workload. 


INTRODUCTION 

This  study  is  a  continuation  of  research  directed  toward  establishing 
the  role(s)  of  a  pictorial  map  display  in  the  commercial  aircraft  cockpit  of 
the  1980s.  Whether  the  map  display  is  to  be  used  as  a  primary  flight  instru¬ 
ment,  or  as  a  status  apprisement/monitoring  display,  or  both,  depends  in  large 
part  upon  the  compatibility  of  the  various  possible  map  display  modes  with  the 
rest  of  the  cockpit  displays.  The  pilot  must  be  able  easily  to  assimilate  the 
information  on  the  map  with  the  information  from  his  other  displays.  Also,  the 
method  of  map  presentation  should  not  introduce  any  perceptual  conflict s  that 
could  lead  to  a  blunder.  A  series  of  part-task  studies  was  planned  to  inves¬ 
tigate  this  compatibility  and  to  obtain  data  and  experience  from  which  recom¬ 
mendations  can  be  made  concerning  certain  map  display  options  for  evaluation  in 
a  full  mission  simulation. 

The  first  experiment  in  the  series  measured  the  effect  of  horizontal 
situation  (ground  path)  predictor  information  on  manual  piloting  performance 
while  executing  a  standard  instrument  procedure  turn. 1  The  second  experiment 
studied  the  effect  of  two  other  variables  on  manual  piloting  performance.2 
These  variables  were:  (1)  the  position  of  the  map  display  relative  to  the 
Vertical  Situation  Display  (VSD)  and,  (2)  the  orientation  and  motion  charac¬ 
teristics  of  the  map  displayed.  Th?  present  experiment  combined  elements  of 
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these  two  experiments,  incorporating  a  predictor  element  into  the  simulation 
environment  of  the  map  position/orientation  experiment  with  its  choice  of  map 
displays  and  a  more  realistic  aircraft  simulation. 

The  primary  purposes  of  this  experiment  were  to  further  assess  the  posi¬ 
tive  utility,  as  well  as  any  possible  negative  effects,  of  incorporating  a 
flight  path  predictor  on  two  different  map  displays.  Specifically  there  were 
five  major  hypotheses: 

1.  The  use  of  the  predictor  would  improve  overall  task  performance. 
Counter  to  this  hypothesis  was  subjective  opinion  that  the  predictor  could  be 
sufficiently  demanding  of  attention  that,  with  certain  conditions,  measured 
performance  could  be  poorer. 

2.  There  would  be  no  predictor/map  orientation  interaction.  This  hypo¬ 
thesis  was  based  on  the  finding  of  no  significant  difference  among  three 
different  map  orientations  in  a  prior  experiment.2  However,  the  importance 
that  would  be  attached  to  any  positive  finding  of  interaction  made  tnis  check 
a  major  objective  of  the  experiment. 

3.  The  use  of  the  predictor  would  reduce  the  differences  in  performance 
among  pilots.  Possible  homogeneity  of  performance  among  pilots  could  be 
another  factor  leading  to  justification  for  specifying  more  narrow  flight 
corridors . 

4.  The  use  of  the  predictor  would  reduce  Ihe  differences  in  tracking 
performance  normally  found  between  significant  crosswind  conditions  and  no 
wind  conditions. 

5.  The  presence  of  simulated  wind  gusts  would  not  significantly  affect 
performance  for  any  condition.  Wind  gusts  were  included  primarily  to  assess 
any  annoyance  factor  related  to  the  predictor  element.  (Possible  interactions 
with  other  predictor  types  were  not  investigated.) 

In  addition  to  these  major  hypotheses  there  was  interest  in  assessing  the 
effect  of  the  predictor  on  two  other  items.  The  first  was  to  determine 
whether  the  predictor  element  had  any  effect  on  pilot  workload.  The  second 
was  to  determine  whether  the  tendency  toward  blunders  (control  reversals  in 
this  case)  would  be  affected.  The  strength  of  the  check  on  these  two  items 
was  not  as  high  as  for  the  formal  hypotheses,  relying  more  on  observation  and 
pilot  comment. 


TASK  AND  PROCEDURES 
Task  and  Displays 

The  task  was  to  fly  from  point  A  to  point  B,  as  in  Fig.  1,  following  the 
360°,  315*,  135#,  180*,  225°,  045*  and  360*  legs  in  that  sequence  while  main¬ 
taining  constant  960  ft  (292  m)  altitude.  The  dynamics  were  representative 
of  a  transport  aircraft.  Throttle  setting  remained  constant  with  a  nominal 
airspeed  of  160  knots.  In  the  absence  of  crosswinds,  a  nominal  25*  bank 
angle  was  required  in  the  turns.  All  flight  information  was  displayed  on  a 
17-in.  (43-cm)  CRT  monitor.  The  display  was  generated  by  an  Evans  6  Suther¬ 
land  LDS-2  graphics  display  computer  using  an  SEL  840  as  the  main  computer. 
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Aircraft  dynamics  and  scoring  procedures  were  also  generated  by  the  SEL  840. 
Appropriate  force-feel  characteristics  were  provided  by  a  hydraulic  control 
loader  system.  Figure  2  is  a  photograph  of  the  simulator  interior. 

Both  the  Vertical  Situation  Display  (VSD)  and  the  Horizontal  Situation 
Display  (HSD)  were  contained  within  5-in.  (12.7-cm)  squares.  Figure  3  is 
a  photograph  of  the  VSD  with  labels  describing  the  display  elements.  The 
nuinber  at  the  top  left  corner  of  the  display  shows  airspeed  in  knots.  The 
center  number  is  aircraft  heading  in  degrees.  The  top  right  number  is  alti¬ 
tude  in  feet,  and  the  number  just  below  altitude  is  the  vertical  speed  readout 
in  feet  per  minute.  The  aircraft  symbol  remained  fixed  in  the  center  of  the 
display  with  pitch  and  roll  indicated  by  movement  of  the  horizon,  ground  plane 
lines,  and  pitch  lines.  The  altitude  error  bar  moved  across  the  scope  in  the 
vertical  direction  only.  A  zero  altitude  error  was  indicated  when  the  error 
bar  was  centered  over  the  center  square  of  the  aircraft  symbol.  Motion  from 
the  center  position  to  the  end  of  the  bar  in  either  direction  indicated  a 
100-ft  (30.5-m)  error.  The  aircraft  was  100  ft  (30.5  m)  too  high  when  the  top 
end  of  the  bar  was  just  touching  the  square  (i.e.,  the  bar  below  the  aircraft 
symbol)  and  100  ft.  (30.5  m)  too  low  when  the  bottom  end  of  the  bar  was  touch¬ 
ing  the  square,  a  sensitivity  of  approximately  250  ft/in.  (30  m/cm).  The 
rectangle  of  the  turn  rate  indicator  moved  horizontally.  Center  position  indi¬ 
cated  zero  turn  rate  and  a  3*/sec  turn  was  indicated  with  the  rectangle 
centered  over  the  right  or  left  bar. 

Figure  4  is  a  photograph  of  the  HSD  with  labels  describing  the  display 
elements.  The  primary  display  elements  were  the  reference  ground  trajectory, 
the  aircraft  symbol,  and  the  predictor  element.  The  aircraft  symbol  gave  both 
heading  and  position  information.  The  aircraft  position  was  the  junction 
point  of  the  wings  and  body.  Tie  other  symbols  were  present  to  provide  a 
touch  of  realism  and  to  provide  background  display  motion,  which  was  considered 
particularly  important  for  the  condition  when  the  aircraft  remained  in  the 
center  of  the  display  during  flight.  For  this  condition,  the  map  translated 
and  additional  symbols,  not  shown  here,  would  come  into  view  at  different 
points  along  the  flight.  The  map  scale  is  1.6  n.mi./in.  (1170  m/cm).  The  pre¬ 
dictor  will  be  explained  in  more  detail  under  "Experimental  Variables." 

One  additional  feature  was  shown  on  both  the  VSD  and  HSD  to  aid  in  timing 
the  start  of  the  turns.  Approximately  5  sec  before  the  transition  point  from 
a  straight-line  section  of  the  reference  ground  trajectory  to  a  circular  sec¬ 
tion,  the  center  square  of  the  VSD  aircraft  symbol  and  the  aircraft  symbol  on 
the  HSD  both  began  to  flash  at  a  2-Hz  rate.  Figure  1  shows  that  there  are  two 
turns  of  180Q  and  four  turns  of  45°.  For  the  45°  turns,  the  flashing  began 
5  sec  before  the  tangent  point  of  a  circle  with  the  same  radius  as  the  180° 
turns.  This  is  illustrated  on  Fig.  1  at  the  045°  to  360°  heading  transition. 

Experimental  Variables 


Map  orientation: 

1.  North  up,  fixed  map  (0.).  With  this  condition,  all  elements  were 
fixed,  the  only  moving  symbols  being  the  aircraft,  which  moved  around  the 
course  to  indicate  present  position  and  heading,  and  the  predictor  element 
(when  used) . 
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2.  Aircraft  heading  up,  rotating  map  (0-0.  The  aircraft  symbol  always 
remained  fixed  in  the  center  of  the  display,  heading  up.  The  predictor  main¬ 
tained  the  same  relationship  with  the  aircraft  symbol  as  for  0^. 

Steady-state  winds: 

1.  Wind  present  (W^) .  Always  32  knots  and  randomly  selected  from  four 
directions,  blowing  from  either  068°,  143°,  233°,  or  338°. 

2.  No  wind  (W0). 

Wind  gusts: 

1.  Gusts  present  (Gj).  RMS  lateral  components  of  5  ft/sec  with  a  zero 
mean.  At  1000  ft  (305  m)  altitude  this  gust  level  is  equalled  or  exceeded 

10  percent  of  the  time.3  The  vertical  component  had  an  RMS  value  of  1  ft/sec. 

2.  No  gusts  (G0). 

Pilots:  The  pilot  participants  for  this  study  were  the  same  six  airline  pilots 
that  had  previously  participated  in  an  earlier  study  in  this  series.2  The  six 
pilots  represented  four  airlines.  One  was  a  captain  and  five  were  copilots, 
of  whom  two  were  currently  flying  as  second  officers  due  to  "bumping"  proce¬ 
dures.  The  average  age  was  40,  average  total  flight  time  about  9500  hr,  and 
all  had  military  experience  with  an  average  of  3,000  hr. 

Predictor: 

1.  Predictor  present  (Pj). 

2,  No  predictor  (PQ) . 

The  predicted  path,  corrected  for  steady-state  wind,  consisted  of  a  solid 
line  extending  forward  from  the  aircraft  symbol  to  a  length  representing  30  sec 
of  flight  time.  The  measured  length  (on  the  face  of  the  scope)  of  this  line 
depended  upon  aircraft  heading  and  velocity,  and  the  strength  and  direction  of 
the  crosswinds  relative  to  the  aircraft  heading.  The  coordinates  for  the  pre¬ 
dicted  aircraft  path  were  computed  for  every  3-sec  interval  into  the  future  so 
the  predictor  path  was  actually  a  series  of  ten  straight  lines  (Fig.  4).  This 
predictor  length  was  chosen  as  reasonable  for  this  experiment  after  first  try¬ 
ing  both  longer  and  shorter  predictors.  The  30-sec  interval  was  also  used  in 
the  prior  experiment . 1 

The  intent  of  this  experiment  was  to  evaluate  the  use  of  the  predictor 
element  for  the  map  application,  rather  than  to  pursue  an  evaluation  of 
various  predictor  parameters.  With  this  in  mind,  the  predictor  equation  inte¬ 
grated  the  following  expression  (plus  compensation  for  steady-winds) : 

tan  $  (1) 
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where 


^  *  yaw  rate 

g  ■  gravitational  constant 
V  ■  aircraft  velocity 
$  ■  angle  of  bank 

Another,  more  complete  expression  for  the  yaw  rate  was  also  programmed 
and  tested  but  not  used  for  the  experiment: 

*  ■  *  <m)  m 

where  r  and  q  are  the  instantaneous  angular  velocities  about  the  aircraft 
inertial  yaw  and  pitch  axes,  respectively,  and  9  is  the  pitch  angle.  As  the 
experiment  was  originally  conceived,  a  predictor  using  Eq.  (2)  was  to  have  been 
the  "best  case";  performance  with  the  simpler  Eq.  (1)  was  to  be  compared  with 
it  to  see  if  there  was  any  detectable  performance  difference  between  the  two. 
However,  the  predictor  using  Eq.  (2)  was  "too  good"  in  that  it  was  too  sensi¬ 
tive,  reflected  changes  in  the  aircraft  states  too  accurately,  and  made  a  pre¬ 
dictor  that  was  too  active,  especially  with  the  simulated  turbulence.  Based 
on  the  negative  comments  from  two  "in-house"  pilots,  that  predictor  was 
omitted  from  the  formal  experiment. 


Procedure 

Instructions:  The  purpose  of  the  experiment,  the  details  of  the  displays, 
the  aircraft  dynamics,  and  the  experimental  conditions  were  all  explained  the 
first  day.  The  stated  task  was,  "Stay  as  close  to  the  reference  ground  tra¬ 
jectory  as  possible  at  all  times  while  still  maintaining  altitude."  The  pilots 
were  instructed  to  set  up  approximately  the  same  turn  rate  for  the  45°  turns 
as  for  the  180°  turns,  using  the  blinking  of  the  aircraft  symbols  to  aid  in 
timing  the  beginning  of  the  turns.  They  were  informed  of  all  the  conditions 
before  each  run,  including  wind  direction.  They  were  instructed  that  "Once 
we  start  a  run  for  data,  I  want  you  to  complete  that  run  unless  something 
unplanned  happens,  e.g.,  something  obviously  wrong  with  the  simulation." 

They  had  a  separate  printed  chart  on  a  clipboard  similar  to  Fig.  1,  with 
headings  and  wind  directions  for  handy  reference. 

At  the  end  of  each  flight,  a  dashed  line  appeared  on  the  map,  showing  the 
pilot  the  ground  track  of  his  entire  flight  path  relative  to  the  reference 
ground  trajectory,  as  shown  in  Fig.  5.  Also  shown  are  the  mean-square  errors 
for  both  lateral  and  altitude  track  (digits  in  upper  left) . 

Performance  measures:  (1)  RMS  error  values  for  both  lateral  and  altitude 
errors;  (2)  elevator  and  aileron  control  activities  recorded  as  RMS  deflec¬ 
tions;  (3)  pilot  questionnaire  given  to  each  pilot  at  the  end  of  the  experiment. 

Training  and  experimental  design:  After  one  day  of  additional  training, 
each  pilot  flew  six  days.  The  pilots  were  randomly  separated  into  two  groups, 
one  group  being  given  one  map  orientation  for  the  first  three  days  and  the 
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other  orientation  for  the  last  three  days.  The  other  group  received  the  map 
orientations  in  reverse  order. 

The  combination  of  two  map  orientations,  two  crosswind  categories,  two 
gust  conditions,  and  two  predictor  conditions  made  a  total  of  sixteen  experi¬ 
mental  conditions  per  pilot.  After  two  warmup  runs  each  day,  each  pilot  made 
one  flight  with  each  of  the  possible  eight  conditions  of  crosswinds,  gusts, 
and  predictors  using  the  map  orientation  chosen  for  that  day.  Thus,  in  the 
course  of  six  days,  each  pilot  flew  three  replications  of  each  of  the  sixteen 
conditions.  Each  flight  took  approximately  6-1/2  minutes.  There  were  at 
least  3  minutes  between  each  flight  with  a  break  of  10-15  minutes  about  half¬ 
way  through  the  session.  Where  practical,  each  pilot  flew  one  or  two  sessions 
each  week. 


RESULTS  AND  DISCUSSION 
Performance  Data 

Horizontal  and  vertical  RMS  errors:  The  left  half  of  Table  I  tabulates 
the  RMS  error  scores  for  the  five  controlled  sources  of  variation  for  this 
experiment.  The  orientation  of  the  map,  i.e.,  fixed  or  rotating,  had  essen¬ 
tially  no  effect  on  the error  scores.  The  presence  of  the  predictor  element 
reduced  the  overall  lateral  error  score  to  63  percent  of  the  error  obtained 
without  the  predictor.  This  was  significant  at  the  0.01  level  (see  analysis 
of  variance.  Table  II).  The  predictor  had  no  significant  effect  on  the  alti¬ 
tude  error  scores.  The  presence  of  crosswinds  significantly  increased  the 
scores  for  both  the  lateral  and  altitude  error  scores.  The  gusts  had  no 
effect  on  the  error  scores.  The  difference  in  performance  among  the  pilots 
was  significant  at  the  0.01  level  for  both  error  scores. 

Since  the  same  six  pilots  participated  in  this  experiment  and  a  similar 
prior  experiment,2  it  is  of  interest  to  compare  performance  between  the  two 
experiments  for  those  conditions  that  were  identical.  Figure  6  compares  both 
lateral  and  altitude  errors,  showing  wide  differences  as  to  how  the  pilots 
performed  relative  to  their  first  experiment.  Generally,  the  overall  perfor¬ 
mance  was  slightly  better  for  this  experiment,  with  two  notable  exceptions. 
Pilot  S  clearly  did  much  poorer  the  second  time  on  the  altitude  task  when 
there  was  a  crcsswind.  Pilot  X  clearly  did  much  better  on  both  the  lateral 
and  altitude  tasks  the  second  time. 

Another  of  the  major  results  can  be  seen  in  Fig.  7,  which  compares  the 
error  scores  with  and  without  the  predictor,  and  with  and  without  crosswinds. 
Five  results  are  apparent: 

1.  The  lateral  errors  are  lower  with  the  predictor,  both  with  and  with¬ 
out  crosswinds. 

2.  There  is  crosswind-predictor  interaction  in  the  lateral  error  scores, 
i.e.,  there  is  less  difference  between  the  "wind—  no  wind"  conditions  with 

a  predictor  than  there  is  between  the  "wind  —  no  wind"  conditions  without  a 
predictor.  This  is  significant  at  the  0.01  level  (Table  II). 

3.  There  is  little  difference  in  mean  altitude  error  performance  with 
or  without  the  predictor. 
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TABLE  I.  Means  and  standard  deviations  of  the  dependent  variables 
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Fig.  7.  Pilot  error  performance  -  with  and  without  predictor;  with  and  without 

crosswinds 


4.  Variability  (standard  deviation)  of  the  error  scores  was  nearly  the 
sane  for  the  "no  wind"  conditions,  with  or  without  the  predictor.  This  was 
true  for  both  lateral  and  altitude  error  scores. 

5.  Variability  of  the  error  scores  for  the  crosswind  conditions  was  less 
when  the  predictor  was  used.  Specifically,  this  variability  was  nearly  the 
same  as  for  the  "no  wind"  conditions.  The  information  presented  by  the  pre¬ 
dictor  apparently  enabled  the  pilots  to  cope  better  with  the  crosswinds  so 
that  their  overall  performance  approached  that  of  the  "no  wind"  conditions. 

The  only  other  interactions  of  any  significance  (Table  II)  involved  pilot 
interactions  with  map  orientation,  predictor,  and  crosswinds.  As  stated  in 
the  Procedure,  each  pilot  first  flew  all  flights  with  one  map  orientation, 
then  with  the  other.  To  balance  sequence  effects,  three  of  the  pilots  made 
all  flights  on  one  orientation  firsc,  and  the  other  three  flew  the  other 
orientation  first.  Even  with  the  experience  of  the  prior  experiment  and  with 
the  full  session  of  training  before  starting  this  experiment  (during  which  it 
appeared  that  there  had  been  very  little  loss  in  skill)  all  of  the  pilots  per¬ 
formed  as  well  or  better  during  the  second  half  of  the  experiment  than  they 
did  during  the  first  half,  regardless  of  the  starting  orientation.  This  would 
account  for  the  pilot-map  orientation  interaction  found  for  both  the  hori¬ 
zontal  and  vertical  scores. 

Figure  8  shows  the  other  two  pilot  interactions,  i.e.,  pilot-predictor 
(lateral  scores  only)  and  pilot-crosswind.  Inspection  will  reveal  two  general 
features.  First,  the  use  of  the  predictor  brought  the  lateral  error  scores, 
both  with  and  without  crosswinds,  into  the  general  region  of  each  pilot's 
performance  without  predictor  and  without  crosswinds.  The  wide  range  of 
scores  on  the  "no  predictor  —  with  crosswind"  condition  points  up  the  differences 
in  ability  among  the  pilots  in  coping  with  the  crosswinds  without  a  predictor. 
Mean  RMS  error  scores  with  standard  deviations  are  listed  in  Table  III.  The 
differences  on  this  (no  predictor  —  with  crosswind)  condition  when  compared  with 
the  general  grouping  of  scores  on  the  other  conditions  account  for  the  majority 
of  the  pilot-predictor  and  pilot-crosswind  interactions. 

Aileron  and  elevator  control  activity;  The  right  half  of  Table  I  shows  a 
signi?IcanF^e?fect~on~the-RMS-aiIeroirand  elevator  activities  for  four  of  the 
five  controlled  sources  of  variation.  All  except  the  map  orientation  showed  a 
significant  difference. 

The  presence  of  the  predictor  reduced  aileron  activity  24  percent.  The 
presence  of  a  crosswind  increased  both  aileron  and  elevator  control  activities. 
The  presence  of  the  gusts  increased  the  level  of  aileron  activity  more  than  the 
presence  of  crosswinds.  Gusts  affected  neither  the  lateral  nor  altitude  error 
scores.  The  significant  differences  among  pilots  reflected  their  difference 
in  approach  to  the  task.  For  example,  pilot  S,  who  had  the  largest  average 
altitude  error  score  (Fig.  8),  also  had  the  lowest  average  amount  of  elevator 
activity  (Fig.  9).  Pilot  U,  however,  who  had  the  lowest  average  altitude 
error  score,  had  the  next  to  lowest  amount  of  elevator  activity. 

There  were  only  two  interactions  of  any  significance  (aileron  activity 
only)  and  those  were  both  pilot  interactions.  The  first,  pilot-orientation 
interaction,  is  accounted  for  in  the  same  manner  as  previously  described  in 
the  section  on  horizontal  and  vertical  errors. 
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LATERAL  ERROR 


Fig.  8.  Individual  pilot  error  performance  -  with  and  without  predictor;  with 

and  without  crosswinds 
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Figure  9  shows  that  the  predictor  had  a  different  effect  on  the  pilots 
regarding  aileron  activity.  For  example,  with  the  predictor,  pilot  S 
reduced  control  activity  much  more  than  did  pilot  U.  The  mean  RMS  control 
activity  values  with  standard  deviations  are  listed  in  Table  IV. 

Figure  10  is  a  companion  to  Fig.  7.  Shown  are  the  previously  mentioned 
significant  differences  in  aileron  activity  due  to  the  predictor  and  due  to 
the  crosswinds.  Figure  10  does  not  show  a  reduction  in  variability  of  the 
scores  with  the  predictor  that  was  found  in  the  error  terms. 

Before  ending  this  section,  the  behavior  of  one  pilot  on  one  flight  (out 
of  288  scored  flights  for  the  entire  experiment)  is  worthy  of  mention.  Pilot  Y, 
flying  the  condition  of  "predictor  off,  no  wind,  no  gusts,  fixed  map"  on  the 
third  from  the  last  flight  of  his  last  day,  reversed  lateral  control  when 
attempting  entry  into  the  180°  turn  to  go  from  a  225°  heading  to  a  045°  head¬ 
ing.  By  the  time  he  recognized  his  error  and  recovered,  he  had  built  up  an 
error  more  than  10  times  his  usual  lateral  deviation  for  the  course.  This 
same  pilot  exhibited  this  same  behavior  on  two  flights  in  the  prior  experi¬ 
ment2  on  exactly  the  same  experimental  conditions.  The  rationale  for  the 
behavior  was  discussed  in  some  detail,  and  will  not  be  discussed  here.  Note, 
however,  that  this  pilot  never  did  adapt  and  feel  comfortable  with  the  fixed 
map.  He  is  the  only  one  that  made  a  strong  report  against  it.  In  this 
instance,  as  in  the  prior  experiment,  when  he  "quit  thinking,"  he  ran  into 
trouble.  For  now,  it  must  be  assumed  that  some  proportion  of  the  pilot  popu¬ 
lation  will  have  trouble  adapting  to  the  fixed  map.  In  such  cases,  control 
reversal  blunders  could  occur.  The  impact  of  this  assumption  on  a  choice  of 
map  orientation  is  to  be  balanced  with  the  potential  perceptual  problems  of 
the  rotating  map.  This  will  be  discussed  further  in  the  next  two  sections. 

Pilot  Comments  and  Questionnaire  Data 

The  most  obvious  new  factor  to  the  pilots  in  this  experiment  was  the 
presence  of  the  predictor  element.  Without  exception,  all  pilots  made  some 
sort  of  spontaneous  comment  during  the  first  training  flight  with  the  pre¬ 
dictor  such  as,  "That's  neat,"  or  "I  like  it,"  or  "That's  weird."  As  the 
experiment  progressed,  their  acceptance  of  the  predictor  was  expressed  by 
other  comments.  "You  sure  can  get  used  to  it  (predictor)."  "Once  you  learn 
how  to  use  it  you  get  to  depend  on  it."  "The  predictor  is  a  good  school  master; 
it  teaches  you  what  to  do  for  the  cases  with  no  predictor."  (This  last  state¬ 
ment,  made  by  pilot  X,  may  explain  his  spectacular  improvement  from  the  prior 
experiment,  as  shown  in  Fig.  6.) 

After  completing  the  experiment,  the  pilots  were  asked  to  answer  26 
questions.  Some  questions  were  quite  complex,  some  were  straightforward,  and 
some  were  probing  efforts,  designed  to  see  just  what  kind  of  information  might 
be  meaningfully  derived  from  direct  questions  about  the  task.  The  procedure 
used  was  that  of  a  structured  interview.  Some  questions  turned  out  to  be  use¬ 
ful  and  some  did  not,  so  only  the  most  relevant  and  interesting  results  are 
presented  here. 

First,  the  pilots  were  asked  to  rank  the  four  display  conditions  (pre¬ 
dictor  on  or  off  for  both  0j  and  02)  in  order  of  preference.  Table  V  summar¬ 
izes  these  results.  All  except  one  pilot  chose  the  "predictor  on"  conditions 
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Fig.  10.  Pilot  control  activity  —  with  and  without  predictor;  with  and  without 

crosswinds 


as  the  first  and  second  choices.  (Pilot  Y  chose  the  heading  up  map  orienta¬ 
tion  as  his  second  choice  in  preference  to  the  other  "predictor  on"  choice, 
although  his  error  scores  were  consistently  better  with  the  predictor.) 
Regarding  the  preferences  for  map  orientation,  it  appears  that  there  was  an 
even  split  between  the  fixed  and  moving  map  conditions.  This  was  the  same  as 
for  the  prior  experiment,2  except  for  one  change:  the  pilots  had  changed 
categories,  i.e.,  five  of  the  six  had  apparently  changed  preference  from  one 
map  orientation  to  the  other. 

On  close  inspection  of  pilot  comments  and  taking  into  account  differences 
between  the  two  experiments,  two  of  these  changes  can  be  explained.  Yet,  half 
of  the  pilots  switched  their  preference  when  exposed  a  second  time  to  these 
two  map  orientations.  All  pilots  had  definite  reasons  for  their  preference 
both  times.  Paraphrasing  all  comments  during  and  after  the  experiment,  the 
pros  and  cons  for  both  map  display  orientations  can  be  stated  as  follows: 

Fixed  map  (Oj) 

Pro:  Visually  stable-very  important  to  some  pilots. 

Con:  Potential  control  reversal  problems  (pilot  Y  as  discussed  in 
preceding  section) . 

Rotating  map  (02) 

Pro:  With  the  aircraft  heading  always  toward  the  top  of  the  display, 
the  direction  of  control  is  always  obvious. 

Con:  The  continual  motion  is  objectionable  to  some.  One  pilot 

reported  slight  vertigo  at  times.  Another  pilot  occasionally 
experienced  a  momentary  feeling  of  being  in  a  spin  during  a 
high  rate  turn. 

The  pilots  were  asked  to  rank  the  relative  advantage  of  having  the  pre¬ 
dictor  for  each  of  the  four  environmental  conditions  shown  in  Table  VI.  Gen¬ 
erally,  the  more  outside  disturbance  present,  the  more  they  felt  it  was  an 
advantage  to  have  the  predictor.  They  had  also  been  asked  to  rate  the  degree 
of  the  advantage  of  having  the  predictor  for  each  of  the  conditions  of  Table  VI 
over  not  having  one  on  a  four-point  scale  of:  (1)  decided  advantage; 

(2)  slight  advantage;  (3)  no  advantage;  and  (4)  detrimental.  All  responded 
with  "decided  advantage"  for  their  first  two  rankings  and  "slight  advantage" 
for  their  fourth  or  last  ranking.  They  were  evenly  split  between  "decided 
advantage"  and  "slight  advantage"  for  their  third  ranking. 

Another  question  was  designed  to  see  how  well  the  pilots  could  rate  their 
level  of  effort  on  the  various  tasks.  They  were  asked  to  estimate  their  effort 
on  each  of  the  eight  conditions  shown  in  Table  VII.  They  were  asked  to  do  this 
as  a  multiple  of  the  reference  task,  which  was  taken  to  be  the  "predictor  off, 
without  crosswind,  without  gust"  condition.  They  were  told  to  rate  a  task 
which  was  half  as  hard  as  0.5,  twice  as  hard  as  2.0,  etc.,  that  is,  they  were 
to  construct  a  ratio  scale.  Table  VII  shows  the  results  for  each  pilot.  Two 
pilots  indicated  that  the  answers  would  be  slightly  different  if  a  comparison 
were  made  between  the  two  map  orientations  but  these  two  were  in  opposite 


TABLE  V.  Pilot  ratings8  of  the  four  display  conditions 


Pilot 

Predictor  on 

Predictor  off 

°i* 

°2 

°l 

°2 

S 

1 

2 

3 

4 

T 

2 

1 

4 

3 

U 

1 

2 

3 

4 

X 

1 

2 

3 

4 

Y 

3 

1 

4 

2 

Z 

2 

1 

3 

4 

^ost  preferred  =  1;  least  preferred  =  4 

*Map  orientations: 

Oj  =  North  up,  fixed  map 

02  =  Aircraft  heading  up,  rotating  map 


TABLE  VI.  Pilot  ratings8  of  the  relative  utility 
of  the  predictor  for  the  four  environmental  conditions 


With  crosswind 

Without 

crosswind 

Pilot 

Without 

gusts 

Without 

gusts 

S 

1 

2 

3 

4 

T 

1 

2 

3 

4 

U 

1 

2 

3 

4 

X 

1 

2 

4 

3 

Y 

1 

2 

4 

3 

Z 

1 

2 

3 

4 

aMost  advantage  =  1;  least  =  4 
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directions  and  would  have  cancelled  out  in  the  averaged  score.  Comparing  the 
mean  results  with  the  control  activity  levels  in  Table  I  shows  some  validity 
in  using  control  activity  levels  as  a  gross  measure  of  relative  workload 
(e.g.,  ref.  1).  With  the  predictor  on,  the  mean  estimate  of  pilot  workload  was 
as  low  or  lower  than  with  it  off.  The  control  activities  were  also  lower.  A 
similar  comparison  with  and  without  crosswinds  showed  similar  results. 

Worthy  of  special  attention  are  the  results  with  and  without  gusts.  The  error 
scores  showed  no  difference,  yet  the  differences  in  control  activity  levels 
were  both  significant  at  the  0.01  level.  This  corresponds  with  the  pilot 
estimates  of  task  workload  which  definitely  reflect  a  feeling  of  increased 
workload  when  coping  with  the  gusts.  Figure  11  is  a  plot  of  aileron  and  ele¬ 
vator  control  activity  versus  the  mean  value  of  the  pilot  estimates  of  work¬ 
load  for  the  eight  experimental  conditions  shown  in  Table  VII.  The  correla¬ 
tion  between  pilot  workload  ratings  and  aileron  activity  was  0.82  (significant 
at  the  0.05  level).  The  correlation  between  workload  ratings  and  elevator 
activity  was  0.92  (significant  at  the  0.01  level).  The  correlation  between 
aileron  and  elevator  control  activity  was  0.90  (significant  at  the  0.01  level). 
Although  not  yet  validated  by  other  workload  measures  these  results  lend  some 
credence  to  future  use  of  both  pilot  ratings  and  control  activity  levels  as 
means  of  comparing  relative  workload  levels. 

Although  there  was  no  actual  eye  scan  data  against  which  to  compare,  each 
pilot  was  asked  to  estimate  the  proportion  of  time  they  spent  looking  at  the 
VSD  and  map  displays  for  each  of  the  four  display  conditions  shown.  Wide  dif¬ 
ferences  were  given  (Table  VIII)  and  the  reasons  for  their  estimates  were  as 
interesting  as  the  numbers  themselves.  The  small  difference  between  the 
average  score  for  fixed  map  and  moving  map  conditions  would  be  expected  from 
the  lack  of  any  significant  differences  in  any  of  the  performance  scores.  Five 
of  the  six  pilots  did,  however,  comment  as  follows  on  why  they  made  changes  in 
estimates  between  the  map  orientation: 

Pilot  S  —  The  movement  (of  02)  seemed  to  attract  (attention)  more. 

Pilots  USX  —  The  motion  (of  02)  was  bothersome  (a  strain)  so  went  to  the 
map  to  get  what  was  needed  and  then  "got  away  from  it." 

Pilot  Y  —  Required  less  time  to  get  information  from  the  moving  map  (02) 
so  less  time  was  spent  on  it. 

Pilot  Z  —  The  slight  increased  time  on  02  was  due  to  the  attraction  caused 
by  the  extra  motion  with  gusts. 

There  was  general  agreement  that  more  time  was  spent  on  the  map  when  the 
predictor  was  on,  because,  as  one  pilot  put  it,  "There  is  more  information 
there.  In  order  to  use  it  you  have  to  look  at  it." 

Generally,  the  pilots  felt  that  the  predictor  provided  a  "fine  tuning" 
capability  that  cannot  be  presented  any  other  way.  They  all  agreed  that  it 
particularly  helped  in  coping  with  the  crosswind.  The  only  complaint  with  the 
predictor  was  its  constant  motion  with  gusts  present.  They  were  asked  to 
rate  how  much  this  bothered  them  on  a  4-point  scale  of:  (1)  very  bothersome, 
(2)  fairly  bothersome,  (3)  slightly  bothersome,  and  (4)  no  bother.  Five 
rated  it  as  "slightly  bothersome,"  and  one  as  "fairly  bothersome." 


-421- 


RMS  AILERON  CONTROL  ACTIVITY  -  ARBITRARY  UNITS  O 


I  pact  cm  IADCC  PIT  / - AILERON  ACTIVITY 

LEAST  SQUARES  FIT - ELEVATOR  ACTIVITY 


<\  PW;6ft  X 

PW  G  8^ 
toVYo°i  // 

° 

O  ^  W, 

O 


ESTIMATED  RELATIVE  WORKLOAD 

I  1  I  I  I 

>0  |  2.5  t  3  0 
Wo!  Wo  Wo  HG,  PoWiG, 
Wo  poWoGi 


RMS  ELEVATOR  CONTROL  ACTIVITY  -  ARBITRARY  UNITS  o 


TABLE  VII.  Pilot  estimates  of  their  relative  workload 


Without  gusts  (G0) 


With  gusts  (Gi) 


Without  (W0) 

With  (Wj) 

Without  (W0) 

crosswind 

crosswind 

crosswind 

1.0 

1.4 

2.0 

1.0 

2.5 

2.0 

1.0 

2.0 

3.5 

1.0 

2.1 

1.5 

1.0 

2.0 

1.2(5) 

tf. 

TABLE  VIII.  Pilot  estimates  of  their  division  of  attention 
between  the  VSD  and  map  displays 


Also,  they  generally  felt  that  the  predictor  was  all  right  the  way  it  was 
presented.  There  was  no  desire  to  lengthen  or  shorten  it.  As  one  pilot  put 
it,  "It's  already  simple  —  keep  it  that  way."  Some  way  to  better  differentiate 
it  from  the  rest  of  the  display  would  probably  be  the  biggest  help.  Two  pilots 
suggested  making  it  a  different  color  if  possible.  One  pilot  suggested  a 
predictor  on-off  button.  Another  pilot  jokingly  said  he  could  sum  up  his 
opinion  of  the  experiment  thusly:  "Give  me  my  predictor  back."  The  other 
pilots  were  not  as  outspoken  but  generally  made  favorable  comments. 

CONCLUDING  REMARKS 

There  is  sufficient  information  from  the  analysis  of  these  data  to 
address  the  five  hypotheses  stated  in  the  Introduction. 

1.  The  use  of  the  predictor  did  improve  the  overall  task  performance  to 
a  significant  degree  as  measured  by  lateral  error.  The  mean  RMS  lateral  error 
with  the  predictor  for  the  entire  experiment  was  63  percent  of  the  mean  scores 
without  the  predictor.  In  addition,  the  standard  deviation  of  the  lateral 
scores  with  the  predictor  was  39  percent  of  the  standard  deviation  of  the 
scores  without  the  predictor.  The  RMS  altitude  errors  were  also  in  favor  of 
the  predictor  but  not  to  a  significant  degree. 

2.  There  was  no  predictor-map  orientation  interaction.  This,  therefore, 
eliminates  any  concern  that  the  presence  of  the  predictor  could  have  an 
adverse  effect  with  either  of  the  display  orientations.  In  fact,  pilot 
reports  indicate  that  the  predictor  helps  eliminate  problems  inherent  in  both 
map  orientations.  It  helps  reduce  the  effect  of  a  possible  control  reversal 
with  the  fixed  map  by  making  an  incorrect  control  input  immediately  obvious 
before  the  error  has  a  chance  to  build  up.  One  pilot  indicated  that  the 
predictor  helped  remove  much  of  the  adverse  effect  of  the  gusts  with  the 
rotating  map  by  showing  what  part  of  the  rotating  motion  was  due  to  the  gusts. 

3.  and  4.  The  use  of  the  predictor  generally  resulted  in  more  homogeneous 
performance  for  all  conditions.  This  included  the  significant  reduction  in 
performance  difference  among  pilots  and  the  significant  reduction  in  errors 
between  the  crosswind  and  no-crosswind  conditions.  This  finding  of  a  general 
decrease  in  variability  due  to  the  information  presented  by  the  predictor 
could  be  important  in  assigning  future  terminal  area  corridor  widths. 

5.  The  presence  of  the  wind  gusts  did  not  significantly  affect  perfor¬ 
mance  as  measured  by  RMS  error  scores.  Their  presence  did,  however,  increase 
pilot  workload  as  measured  by  control  activity  levels  and  by  pilot  reporting. 

Whether  or  not  the  predictor  reduced  pilot  workload  could  not  be  as 
directly  determined  as  the  above  five  hypotheses.  Control  activity  levels 
were  measured  but  were  an  unproved  measure  of  workload.  The  fact  that  pilot 
ratings  of  workload  correlated  highly  with  the  control  activity  levels  lent 
support  to  both  as  measures  of  relative  workload.  Neither  would  have  stood 
strongly  on  its  own  merits.  On  the  basis  of  this  supporting  evidence,  it  is 
concluded  that  the  predictor  does  generally  reduce  pilot  workload. 

The  last  experimental  question  concerned  blunders  due  to  control  rever¬ 
sals.  Only  one  pilot  (Y)  experienced  reversal  problems  throughout  this 


experiment  with  the  fixed  map  orientation.  This  problem  was  mostly  overcome 
by  continuously  "thinking  ahead"  regarding  which  direction  the  next  control 
motion  was  to  be  made.  The  result  of  a  lapse  in  this  planning  has  already 
been  described  in  the  Results  and  Discussion  section.  The  problem  was  essen¬ 
tially  eliminated,  however,  when  the  predictor  was  present,  because  the 
predictor  quickly  alerted  him  to  any  control  motion  made  in  the  wrong 
direction. 

Based  on  the  results  of  this  experiment,  the  predictor  appears  to  be  a 
valuable  addition  to  electronic  map  displays.  A  simple  wind- compensated  pre¬ 
dictor  similar  to  the  one  used  in  this  study  should  not  impose  a  significant 
additional  load  on  a  modem  airborne  computer.  The  motion  of  the  predictor 
should  be  relatively  smooth,  it  should  be  free  of  flicker,  and  it  should  be 
coded  in  some  way  (e.g.,  color  or  intensity)  to  make  it  stand  out  over  other 
lines  on  the  display. 
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Previous  Inflight  studies,  In  which  a  single  control  with  a  built-in 
kinesthetic-tactual  display  was  employed,  prompted  further  experimental 
work  with  two  such  control -display  arrangements  for  simultaneously 
presenting  Independent  Information.  Here,  three  different  compensatory 
tasks  were  performed  In  a  ground-based  simulator  under  four  display 
conditions: 

I.  Visual  displays  only; 

II.  Two  visual  and  one  tactual  display; 

III.  Two  visual  and  the  other  tactual  display;  and 

IV.  One  visual  and  two  tactual  displays. 

The  tasks  were  chosen  to  simulate  typical  Inflight  Informational  Inputs. 
Performance  was  assessed  by  comparing  the  results  from  the  tactual - 
display  conditions  and  with  those  from  the  visual  task  conditions. 

Preliminary  findings  are  as  follows:  First,  the  simultaneous  use 
of  two  tactual  displays  of  the  type  described  herein  does  not  result 
In  performance  degradation  over  the  cormionly  used  visual  displays; 

Second,  after  training  little  relative  Interference  existed  between 
simultaneously  performed  tactual  tasks;  and  Third,  there  was  no  appreciable 
cross -modality  Interference  between  the  tactual-  and  visual  tasks  which 
were  performed  simultaneously. 


I,  INTRODUCTION 


The  manual  control  of  a  vehicle  under  hiah  visual  loadino  conditions 
can  he  an  exacting  task,  exoecially  when  an  onerator  must  freguentlv  shift 
his  attention  from  panel  Instruments  to  the  external  environment.  Various 
investigators  have  suggested  that  his  task  could  he  greatly  eased  If  some 
control  information  were  oresented  via  nonvisual  modalities.  One  of  these, 
the  auditory  modality,  has  lono  been  considered  for  use  In  a  numher  of  . 
tasks  rangina  from  flying  by  auditory  reference  (the  1°45  FLYRAR  study) 
to  the  use  of  aural  glide  slope  cues  In  a  1PF8  study. * 

The  cutaneous  modalltv  has  also  been  used  for  many  years  (e.g.,  stick 
shakers  for  aircraft  stall  warning),  and  has  been  the  suhlect  of  a  number 
of  other  interestlno  approaches  for  information  transfer.  These  Include 
a  two-way  vlbrotactlle  communication  system,3  a  stomach-chest  "cross"  of 
stimulators  for  Information  transfer,4  and  an  alrjet  stimulator  moving  across 
the  forehead.  (An  excellent  overview  of  such  efforts  is  contained  in  both 
Reference  6  and  In  a  special  Issue  of  IF EE  Han-Machine  Transactions7  which 
was  devoted  to  tactual  displays). 

Until  now,  the  efforts  undertaken  primarily  have  been  laboratory 
studies;  whereas,  few  effective  and  practically  Implementahle  displays 
have  been  reported.  One  of  the  few  is  a  kinesthetic-tactile  display 
evaluated  by  Fenton  and  others8"10  In  a  series  of  both  simulated  and  full- 
scale  vehicular  control  situations.  This  has  Involved  the  presentation 
of  unidirectional  control  information  in  close  headway,  car-following 
situations  and  In  two  difficult  aircraft  control  situations.  In  the  former, 
significant  reductions  In  headway  variation  were  obtained  using  this 
display  as  compared  to  visual  tracking  of  a  lead  vehicle—  +0.6  ft  versus 
+3.3  ft  with  a  target  headway  of  33  ft  at  40  mph.  In  the  latter,  Inflight 
Investigations  were  conducted  to  assess  kinesthetic-tactual  presentations 
of  angle-of-attack  Information  via  a  display  built  into  an  aircrafts 
yoke.  Significant  improvements  In  pilot's  performance  were  obtained 
when  visual  attention  was  diverted  outside  the  cockpit  partic¬ 
ularly  during  a  series  of  turns  about  a  point.  Tne  tactual  display  as 
compared  with  a  visual  display  of  the  same  information  showed  a  55%  reduction 
in  angle-of-attack  tracking  error  (P  <  .01)  and  a  reduction  in  the  maximum 
altitude  variation  and  speed  variation  by  51%  and  33%, respectively. 

The  present  study  is  focused  on  the  presentation  o+  independent  infor¬ 
mation  via  tv u  kinesthetic-tactual  displays,  and  it  has  three  goals: 

a)  The  efficacy  of  such  dlsnlays  as  compared  to  visual  displays 
which  are  typical  of  inflight  cockpit  presentations; 

b)  The  determination  of  the  relative  interference  betv/een 
simultaneously  performed  tactual  tasks;  and 

c)  The  determination  of  any  cross -modality  interference  between 
tactual  and  visual  tasks  performed  simultaneously. 

II.  DISPLAY  DESCRIPTION 

A  kinesthetic -tactile  display,  which  is  described  In  greeter  detail  in 
Reference  8,  consists  of  a  rectangular  metal  slide  mounted  in  the  head  of  a 


control  stick  such  as  is  shown  In  Fiq.  1.  A  forward  Drotruslon  of  the  slide 
corresoonds  to  a  "positive"  error,  and  the  corrective  response  is  movement 
of  the  stick  forward  so  as  to  decrease  the  error  and  return  the  slide  to  Its 
neutral  or  flush  position.  An  aft  protrusion,  such  as  Is  shown  In  Flo.  1, 
would  require  an  aft  corrective  motion  of  the  control  stick.  In  essence, 
a  subject  follows  the  displayed  tactual  sional  with  the  control  to  reduce 
the  displayed  error  to  zero.  The  slide  is  controlled  by  a  servo  with  a 
natural  frequency  of  some  32  rad/sec  and  a  damolno  ratio  of  0.5;  thus  the 
display  dynamics  are  negligible  In  comparison  with  those  of  the  sublect  and 
plant. 

This  presentation  differs  markedly  from  vibrotactlle  and  alrjet  stimula¬ 
tion,  In  that  It  Involves  active  feedback  as  opposed  to  a  purely  passive 
conveyance  of  somesthetlc  Information.*  It  may  be  viewed  as  analoqous  to 
braille  In  that  It  Is  characterized  by  "embossed"  features,  and  thus  the 
subjects  manipulations  engender  the  stimulus  patterns.  This  qreatly  enhances 
tactual  acuity  and  allows  alterations  in  the  resulting  spatio-temporal  patterns 
for  desired  dlscrlmlnablllty.**  However,  this  analoqv  Is  only  partially 
complete  since  the  rectangular  slide  provides,  in  effect,  a  larqe  "dot"  with 
variable  positive  and  negative  heloht,  thus  allowing  a  continuous  dimension 
for  Informational  transmission  --  e.g.,  magnitude  and  direction. 

The  constant  handling  of  the  control  with  Its  attendant  displayed  error 
creates  a  close  stimulus-response  site  of  action.  Subiects  frequently 
referred  to  the  compelling  nature  of  the  presentation  and  how  quickly  the 
required  control  actions  were  performed  without  conscious  thought. 


III.  EXPERIMENTAL  APPARATUS 

The  experiment  was  conducted  using  the  movlnq-base  simulator  shown  In 
Fig.  2.  The  enclosed  si nol e-seat  cockpit  was  mounted  on  a  steel  structure 
so  that  It  could  both  be  tilted  fore-and-aft  and  rolled  from  side-to-side 
to  provide  motion  cues.  A  front-mounted  instrument  panel  contained  two  visual 
displays  --  an  airspeed  Indicator  and  a  conventional  local Izer-ql Idesl one 
(cross-pointer)  display.  The  first  of  these  presented  airspeed  values 
In  proportion  to  the  cab  pitch,  and  the  second  presented  was  information 
analogous  to  alldeslope  deviation  and  lateral  deviation  from  a  desired  path. 

Two  control  sticks,  each  of  which  contained  a  built-in  kinesthetic- 
tactual  display  were  installed.  One  was  located  directly  in  front  of  a 
subject  and  corresponded  to  an  aircraft  yoke.***  Fore-and-aft  motions 


*  The  active  feedback  employed  here  is  reminescent  of  Gibson's  thesis 
on  the  active  nature  of  perceptual  information.  For  touch,  Gibson 
used  the  term  haptic  perception. 

**  Compare  this  with  the  generally  Ineffective  sensation  of  braille  charac¬ 
ters  when  a  reader  simply  presses  his  finger  onto  the  one-to-six  dot 
matrix  without  movement,  the  Purely  spatial  passive  pattern  created 
Is  difficult  to  recognize. 

***  This  control  was  used  In  previous  inflight  studies  wherein  It  replaced 
the  yoke  in  a  Cessna  172.'® 
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controlled  cab  pitch,  and  hence  airspeed,  while  rotary  motions  controlled 
both  cab  roll  and  lateral  deviations  from  the  "localizer".  The  second 
stick  was  located  to  the  right  of  the  subject,  and  was  analogous  to  an  air¬ 
craft  throttle  controlling  the  glldeslope. 

The  cab  \  as  enclosed  to  prevent  a  subject  from  directly  observing  pitch 
or  roll.  Therefore,  all  control  was  either  based  on  displayed  Information— 
visual  or  tactual—  or  obtained  with  the  assistance  of  these  motion  cues. 


IV.  EXPERIMENTAL  DESCRIPTION 

A  complex  control  problem  was  posed  by  using  three  random  and  Independent 
forcing  functions  to  vary  the  airspeed  about  an  average  value,  and  to  cause 
both  localizer  and  glldeslope  deviations.  A  subject's  task  was  thus: 

a)  To  maintain  a  constant  airspeed; 

b)  To  maintain  his  centered  localizer  course;  and 

c)  To  maintain  the  proper  alldeslooe. 

These  tasks  are  depicted  In  the  block  diagram  of  Fig.  3  which  shows  the  three 
control  loops  of  Interest.  The  airspeed  or  pitch  loop  contains  the  dynamics 
which  are  associated  with  the  pitching  of  the  cockpit  as  well  as  a  flrst-ord^r 
lag  which  Is  Intended  to  account  for  the  delay  between  changes  In  an  aircrafts 
angle  of  attack  and  a  corresponding  change  In  the  airspeed  Indicator.  Simi¬ 
larly,  the  localizer  control  loop  contains  the  simulator  roll  dynamics.  The 
glldeslope  control  loop  contains  only  a  first-order  lag  and  was  not  coupled 
to  cab  motion. 

Performance  was  assessed  on  the  basis  of  absolute  Integrated  error  for 
each  measured  variable  --  airspeed,  lateral  deviation  and  glldeslope  deviation. 

Three  preliminary  tests,  In  which  four  display  conditions  were  utilized, 
were  conducted.  The  conditions  were  numbered  In  order  of  decreasing  visual 
demand.  Thus,  In  Condition  I  all  Information  was  presented  visually  on  two 
displays;  In  Condition  II  localizer  and  airspeed  Information  were  presented 
visually  on  two  displays  (the  glldeslope  movement  was  deactivated)  and 
glldeslope  Information  was  presented  tactually;  In  Condition  III,  both 
localizer  and  glldeslope  Information  were  presented  on  a  single  visual  display 
and  airspeed  was  presented  tactually;  and  In  Condition  IV,  there  was  a  single 
visual  display  of  localizer  Information  and  a  tactual  display  of  airspeed 
deviation  In  the  lefthand  control  and  glldeslope  deviation  In  the  rlghthand 
one. 


Prior  to  testing,  each  subject  underwent  approximately  45  minutes  of 
trial  runs  under  all  display  conditions  to  familiarize  him-  or  herself  with 
the  control  task.  The  same  conditions  were  present  here  as  during  the 
subsequent  data-collectlng  phase. 

Five  subjects  participated  In  each  of  3  tests— hereafter  referred  to 
as  tests  1,  2,  and  3.  In  Test  1,  Conditions  I,  III,  and  IV  were  considered 
with  each  subject  making  6  3-mlnute  runs  per  condition.  Appropriate  counter¬ 
balancing  procedures  were  employed  to  minimize  any  secondary  learning  effects. 
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Figure  3.  Block  diagram  of  control  tasks. 


Followinq  this,  Test  2  which  consisted  of  Conditions  I,  II  and  IV 

and  1  run/subject/condltlon,  was  conducted.  Learning  effects  were  considered 

minimal  and  counterbalancing  was  net  employed. 

After  comparlnn  the  results  from  Tests  1  and  2,  It  was  decided  to  change 
the  glideslope  control  stiffness  and  the  tactual  display  sensitivity.  These 
modifications  were  utilized  In  Test  3,  In  which  Conditions  II,  III  and  IV 
were  considered,  and  1  run/subject/dlsolav  condition  was  obtained.* 

V.  RESULTS  AND  DISCUSSION 

An  analysis  of  variance  was  performed  for  each  of  the  three  test  sets 
with  both  task  and  display  condition  taken  as  fixed  effects  and  subjects  as 
a  random  one.  The  results  are  shown  In  Table  I-III. 

Two  effects  were  significant  In  Test  1:  Airspeed  deviations  indi¬ 
cating  an  Improvement  In  airspeed  control  for  the  tactual  over  the 
visual  condition;  and  alldeslope  deviations  Indicating  degraded  oerfor- 
mance  for  the  tactual  versus  the  visual  condition.  The  former  Is 
clearly  shown  In  Flo.  4  v.'here  the  average  results  for  each  task  have 
been  plotted  versus  condition.  Mote  from  4(b)  that  a  substantial 
reduction  In  the  averaged  alrsneed  deviations  was  obtained  for  both 
tactual  display  conditions  (III  and  IV)  as  comnared  to  the  visual  dis¬ 
play  condition  (I).  An  examination  of  the  glideslope  deviations 
(Fig.  4(c))  reveals  a  detrimental  effect  with  the  simultaneous  use 
of  a  tactual  display  In  each  hand  (Condition  IV). 

In  Test  2,  alrsoeed  deviations  were  significant  at  the  .05  level  --  a 
significance  which  Is  again  clearly  evident  In  Fla.  4(b).  Per  Fig.  4(c), 
there  Is  again  a  slight  detrimental  effect  with  Condition  IV;  however,  this 
was  not  significant. 

Either  some  Interference  existed  between  the  simultaneously  performed 
tactual  tasks  or  some  other  problem  was  nresent.  Evidence  contrary  to  an 
Interference  hypothesis  are: 

a)  The  lack  of  Interference  In  the  airspeed  task  In  Test  1  when 
Condition  IV  Introduced  a  second  tactual  task; 

b)  The  essentially  Invariant  localizer  task  oerformance  where  there 
appeared  to  be  little  cross -modality  Interference  between  visual  - 
and  tactual  task  performance;  and 

c)  Visual  task  performance  was  unaffected  reaardless  of  whether  1  or 
2  visual  displays  (Conditions  II  and  III)  were  used  to  present 
two  sources  of  Information  (l.e. ,  required  shifts  In  qaze  had 
little  effect  on  task  performance).  (See  Flq.  4). 

The  relative  lack  of  Intra-  and  Inter-modality  Interference,  combined 
with  the  failure  to  obtain  the  expected  Improvement  In  single  tactual  tracking 
with  glideslope  information  (Condition  II,  Test  2),  suggests  that  the  apoarent 
decrement  In  Condition  IV  was  the  result  of  a  less  than  satisfactory 


This  effort  Is  currently  in  pronress  and  additional  data  are  being 
collected. 
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TABLE  I 

ANOVA  Summary  Table  for  Test  1  with 
(Mote:  replication  and  Interaction 
(o  >  .10)  and  were  not  Included) 

Conditions  I,  III  and  IV 
terms  were  not  slonlflcant 

Variable 

Source 

Error 

Term 

df 

Mean 

Souares 

F 

Ratio 

Localizer 

n 

SA 

26.266 

93.330 

2 

8 

13.133 

11.666 

1.126 

Airspeed 

9 

SA 

1540.071 

843.356 

2 

8 

770.035 

105.419 

7.305* 

G11 deslope 

■ 

SA 

65.803 

40.946 

2 

8 

32.902 

5.118 

6.428* 

TABLE  II 

ANOVA  Summary  Table  for  Test  2  with  Conditions  I,  II  and  IV 

(Note:  Interaction  terms  were  not  slonlflcant  (o  >  .10)  and 

were  not  Included) 

Variable 

Source 

Error 

df 

— 

F 

Term 

Ratio 

Localizer 

A 

SA 

7.755 

2 

3.878 

1.794 

SA 

17.294 

8 

2.162 

Airspeed 

A 

SA 

194.940 

2 

97.470 

17.599* 

SA 

44.306 

8 

5.538 

Oil  deslope 

A 

SA 

14.536 

2 

7.268 

1.562 

SA 

37.222 

8 

4.653 

A  *  conditions 
S  *  subjects 

*  *  significance  beyond  the  0.05  level 
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AMOVA  Summary  Table  for  Test  3  with  Conditions  II,  III  and  IV 
(Note:  Interaction  terms  were  not  slanlflcant  (p  >  .10)  and 
were  not  Included) 


Variable 


Source  Error 
Term 


Sum  of 
Squares 


Localizer 

S 

Airspeed 

S 

Glldeslope 

S 

control /tactual  display  combination.  This,  together  with  subiect  comments, 
led  to  Test  3.  This  test  was  run  after  the  glldeslope  control  stiffness 
was  reduced  and  the  display  sensitivity  was  increased. 

These  changes  were  clearly  useful,  as  ner  Table  III,  glideslooe  devia¬ 
tions  were  slqnlficantly  reduced  (.05  level).  This  is  also  evident  from  an 
examination  of  Fig.  4(c). 

The  results  from  the  other  tasks  are  similar  to  the  previous  findings. 
For  airspeed  data  (Fig.  4(b)),  It  is  seen  that  a  substantial  decrease  In 
airspeed  deviations  was  again  obtained  for  the  two  conditions  (II  and  III); 
strangely  enough,  these  were  not  significant.  Once  again  the  localizer 
deviations,  which  were  not  significant,  tended  to  be  invariant  with  condi¬ 
tion  (See  Fig.  4(a)). 


VI.  CONCLUSIONS 

The  preliminary  and  Incomolete  results  Dresented  here  sugqest  that, 
at  least  In  the  confines  of  a  laboratory,  the  simultaneous  use  of  two  tactual 
displays  of  the  type  described  herein  does  not  result  In  performance  degra¬ 
dation  over  the  commonly  used  visual  displays  and  may  possibly  result  In 
some  Improvement.  Further,  In  practice  visual  attention  must  be  frequently 
directed  away  from  the  monitoring  of  Instruments.  It  Is  nrobable,  In  lioht 
of  previous  evidence,™  that  visual  oerformance  would  be  significantly 
degraded  comoared  to  tactual  oerformance,  both  In  the  laboratory  simulator 
and  Inflight.  It  would  seem  appropriate  to  extend  the  tests  described  here 
to  encompass  such  situations. 

It  also  seems  clear,  that  after  tralnlno,  little  relative  Interference 
exists  between  simultaneously  performed  tactual  tasks,  nor  was  there  any 
appreciable  cross-modality  interference  between  the  tactual-  and  visual 
tasks  which  were  performed  simultaneously. 

Subsequent  studies  should  be  performed  to  Investigate  the  ootentlal 
extent  of  Information  presented  in  this  fashion  to  the  cutaneous  modality. 

For  example,  Investigations  could  be  undertaken  to  study  the  use  of  two 
tactual  displays  in  a  single  control  handle.  Further,  whether  two  control 
handles,  both  with  multiple  displays  Installed,  can  be  effectively  used. 

These  studies  should  focus  on  similar  goals  to  those  suggested  In  this 
paper.  That  Is,  the  efficacy  of  such  disolays  as  compared  to  visual  displays 
which  are  typical  of  present-day  cockpit  presentations;  the  determination 
of  relative  Interference  between  simultaneously  performed  tactual  tasks; 
and  the  determination  of  any  cross -modality  Interference  between  tactual 
and  visual  tasks  performed  simultaneously. 
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ABSTRA.  I 


Six  helicopter  pilots  participated  in  a  simulator  study  to  compare  and  evaluate 
design  features  of  three  electronic  displays  for  potential  application  to  V/STOL 
zero-zero  landings:  the  RAE  proposed  combined  transition  display,  the  SAAB 
perspective  display,  and  the  TELDIX  hover  display. 

The  experimental  task  was  flown  in  a  fixed-based  simulation  of  the  Bell  UH-1 
helicopter,  without  stability  augmentation,  and  consisted  of  a  straight-in 
approach  with  a  commanded  constant  speed  segment  and  a  deceleration  segment. 
Approaches  were  made  down  to  approximately  20  knots  indicated  airspeed.  The 
hover  mode  was  not  evaluated  since  the  SAAB  perspective  display  did  not  pro¬ 
vide  a  hover  capability.  The  six  pilots  flew  data  runs  on  each  of  the  three 
displays  with  6*  and  15*  flight-path  angles,  with  and  without  wind  conditions. 
The  three  displays  were  presented  on  t  stroke-written,  multifunction  CRT  and 
were  slightly  modified  from  original  cnc.epts. 

Objective  measures  were  obtained  of  tracking  performance,  attitude  variability, 
and  control  activity  and  were  analyzed  by  an  analysis  of  variance.  Pilot 
opinion  was  also  obtained.  It  was  concluded  that  (1)  the  RAE  display  is  less 
effective  than  the  SAAB  or  TELDIX  displays  for  localizer  tracking;  (2)  pilot 
workload,  as  indicated  by  RMS  variability  measures,  was  lowest  with  the  SAAB 
display  and  highest  with  the  TELDIX  display;  (3)  time  to  capture  was  shortest 
with  the  TELDIX  display  and  longest  with  the  RAE  display;  (4)  extensive  central 
clutter  on  the  TELDIX  display  probably  resulted  in  its  being  given  the  lowest 
pilot  opinion  rating;  and  (5)  pilot  opinion  favoring  the  RAE  display  over  the 
SAAB  display  was  at  variance  with  objective  performance  measures. 


INTRODUCTION 


Ames  Research  Center  has  initiated  a  series  of  simulation  and  flight  studies 
using  a  stroke-written,  multifunction  CRT  to  develop  display  concepts  for 
application  to  vertical/short  takeoff  and  landing  (V/STOL)  zero-zero  landings. 
The  resultant  display  concepts  are  expected  to  enhance  both  general  V/STOL 
and  tilt-rotor  technology. 

A  requirement  for  an  increased  capability  of  V/STOL  aircraft  to  operate  in 
low-visibility  and  zero-zero  visibility  environments  and  the  need  for  new 
displays  to  realize  this  increased  capability  have  been  substantiated  in 


references  1  and  2,  with  reference  to  military  operations.  Similar 
requirements  exist  for  commercial  operations. 

Manual  piloting  of  V/STOL  aircraft  during  approach  and  landing  is  assumed 
to  be  required  for  an  indefinite  period  for  two  reasons.  First,  V/STOL 
technology  is  at  an  early  stage  of  development.  Reference  2  states  that: 

"At  the  present  stage  of  development,  reliability  and  cost  of  systems  for 
guidance,  control  and  stabilization  for  V/STOL  aircraft,  operational  blind 
landings,  with  or  without  pilot  control,  are  not  to  be  expected  in  the  near 
future."  Secondly,  the  capability  that  should  be  provided  for  manual 
emergency  takeover  during  operational  blind  landings  has  not  been  resolved. 

The  commercial  V/STOL  approach  and  landing  problem  differs  from  that  for 
conventional  takeoff  and  landing  aircraft  in  that  the  following  requirements 
are  assumed:  steep  and/or  curved  approaches  at  low  and/or  decelerating  speeds; 
transition  to  hover;  highly  precise  energy  management;  and  high-density, 
time-constrained  flight  environments.  The  latter  requirement  is  assumed 
necessary  from  an  economic  standpoint. 

In  consideration  of  aspects  of  these  requirements,  and  after  a  review  of 
related  research  on  separated  vertical  and  horizontal  situation  displays, 
reference  2  concluded  that:  "The  mass  of  information  to  be  absorbed  by  the 
pilot,  usually  in  different  axes,  poses  peculiar  problems  in  the  integration 
of  information  and  implies  the  use  of  combined  dl  plays."  They  further  con¬ 
cluded  that:  "Due  to  their  limited  versatility,  conventional  electro-mechanical 
instruments  do  not  have  suitable  characteristics  for  the  V/STOL  approach  and 
landing  case.  Existing  electronic  displays  and  the  advanced  techniques  being 
tested  in  laboratories  and  simulators  hold  more  promise." 

The  objective  of  this  initial  study  was  to  compare  and  evaluate  design  fea¬ 
tures  of  three  electronic  displays  selected  from  reference  2:  the  RAE  proposed 
combined  transition  display,  the  SAAB  perspective  display,  and  the  TELDIX 
hover  display.  The  study  conditions  purposely  included  a  simulated  vehicle 
without  stability  augmentation,  with  approaches  to  hover  in  a  speed  range 
above  20  knots  indicated  airspeed.  No  attempt  was  made  to  evaluate  the  dis¬ 
plays  in  hover  since  the  SAAB  display  diet  not  provide  a  hover  capability. 


DESCRIPTION  OF  EXPERIMENTAL  DISPLAYS 


The  three  selected  displays  were  slightly  modified,  primarily  by  adding 
digital  information  before  the  comparative  study.  Figures  1,  2,  and  3  present 
these  modified  displays;  the  dr  ving  functions  for  the  display  elements  are 
described  and  scale  factors  inc1  seated .  A  heading  tape  and  window  were  added 
to  all  displays  for  presentatl  n  of  digital  heading;  the  compass  rose  was 
eliminated  from  the  RAE  and  TLLDIX  displays.  Only  heading  error  was  presented 
on  the  SAAB  display  before  this  addition. 

Two  step  changes  In  scale  factor  were  provided  for  the  RAE  and  TELDIX  dis¬ 
plays.  The  outer  range  mark  for  each  display  represents  20,000  ft  initially. 
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When  ground  range  becomes  less  than  4,000  ft,  the  outer  range  mark  represents 
4,000  ft.  When  ground  range  becomes  less  than  800  ft,  the  outer  range  mark 
represents  800  ft.  Other  modifications  are  discussed  below  for  individual 
displays. 


Modified  RAE  Proposed  Combined  Transition  Display 

The  RAE  display  (Fig.  1)  combines  horizontal  and  vertical  situation  informa¬ 
tion  in  a  single  diagram  and  presents  ground  speed  as  a  vector.  The  scaling 
of  the  velocity  vector  is  such  that  the  appropriate  ground  velocity  rate  is 
attained  whenever  the  endpoint  of  the  velocity  vector  is  superimposed  on  the 
landing  pad  and  along  the  appropriate  approach  direction.  Both  nominal  and 
actual  rates  of  descent  are  displayed.  A  horizon  bar  was  added  to  the  dis¬ 
play  to  obtain  pitch  and  roll  information.  A  display  of  glide-slope  devia¬ 
tion  was  also  added.  Angle  of  attack  was  removed  from  the  display  since  it 
was  not  required  with  a  helicopter  simulation. 


Modified  SAAB  Perspective  Display 

The  SAAB  display  (Fig.  2)  indicates  heig'it  error  by  the  position  of  the 
horizon  line  relative  to  the  upper  end  of  perspective  "poles."  Flight- 
path  angle  and  course  are  displayed  by  the  relationship  of  the  velocity 
vector  to  tlu  aiming  dot  in  a  "fly-from"  implementation.  Height  error  and 
roll  information  are  presented  in  conventional  "fly-to"  Implementations. 

A  reference  height  pole  is  provided  for  use  in  determining  absolute  altitude. 
Airspeed  error  is  indicated  by  the  distance  of  the  airspeed  error  indicator 
(line)  from  the  periphery  of  the  velocity  vector  symbol.  Altitude  rate  was 
added  to  the  display  for  standardization.  Digital  displays  of  altitude, 
airspeed,  and  distance  to  go  were  also  added. 


Modified  TELDIX  Hover  Display 

The  TELDIX  display  (Fig.  3)  differs  from  the  RAE  display  mainly  in  that  less 
prominence  is  given  to  the  velocity  vector;  ground  speed  is  displayed  as 
length  of  the  velocity  vector  with  reference  to  range  marks;  glide  slope  and 
course  deviation  are  displayed  by  cross  pointers  (horizontal  and  vertical 
lines) ;  and  the  nominal  rate  of  descent  is  not  presented.  Altitude  rate 
was  added  to  the  display  for  standardization. 


METHOD 


Simulation  Facility  and  Task 

The  experimental  task  was  flown  in  a  fixed-based,  digital  simulation  of  the 
Bell  UH-1B,  single  lifting  rotor  helicopter  with  conventional  tail  rotor. 
Figure  4  is  a  diagram  of  the  simulation  facility  and  figure  5  is  a  photograph 
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of  the  simulation  chair  cab.  The  three  experimental  displays  were  presented 
to  the  pilots  on  a  Sperry  flight  system,  stroke-written  multifunction  display 
(MFD)  located  in  the  chair  cab. 

The  UH-1B  chair  cab  was  fitted  with  conventional  helicopter  collective  and 
cyclic  controls  and  tall  rotor  pedals.  A  UH-l-type  force-feel  system  was 
provided  on  the  cyclic  control  and  tall  rotor  pedals  which  could  be  disengaged 
by  a  switch  on  the  Instrument  panel  or  by  a  pushbutton  on  the  cyclic  control. 
Rotor  speed  was  assumed  to  be  under  governor  control  and  was  fixed  at  323  rpm. 

The  MFD  unit  was  located  on  the  instrument  panel  6-1/2  in.  to  the  right  of  the 
pilot  centerline.  Conventional  Instruments  (also  located  on  the  instrument 
panel)  and  the  out-the-wlndow  display  were  covered  during  the  experiment. 
Display  symbology  was  updated  20  times  per  second.  The  usable  display  area 
was  6.5  in.  wide  by  7.0  in.  high.  Figures  6  through  9  are  photographs  of  the 
RAE,  SAAB,  and  TELD1X  displays  which  generally  present  error  conditions. 

Figure  7  shows  the  SAAB  display  without  error  for  comparison. 

The  task  was  to  fly  a  straight-in  landing  approach  at  the  commanded  speed: 
initial  constant  speed  during  the  first  segment  of  the  approach  path  and 
commanded  deceleration  thereafter.  Capture  of  approach  localizer  and  glide 
slope  from  initial  offset  conditions  (table  1)  was  also  required.  The  local¬ 
izer  and  glide-slope  displays  were  processed  to  represent  constant  widths  of 
1400  and  ±50  ft,  respectively.  Guidance  equations  for  the  deceleration  pro¬ 
files  are  given  in  table  2. 


Experimental  Design 

Table  3  shows  the  modified  Latin  square  design  selected  for  use  in  this 
experiment.  The  wind  sequences  Wh  through  Wfc  and  W*  through  W0  were 
randomly  selected  without  replacement  for  each  cell  of  the  matrix  from  four 
wind  conditions:  (1)  +24°,  18  knots;  (2)  -24°,  18  knots;  (3)  no  wind;  and 
(4)  no  wind.  The  second  wind  condition  and  the  second  no-wind  condition 
were  treated  as  repeated  measures. 

Pilots:  Six  pilots  participated  in  the  experiment.  Pilots  1  through  3 
were  experimental  test  pilots.  Pilots  4  and  6  were  commercial  airline  heli¬ 
copter  pilots.  Pilot  5  was  a  commercial  airline  fixed-wing  pilot  with 
military  helicopter  experience.  Table  4  summarizes  the  flying  experience 
of  the  six  pilots. 

Displays:  The  three  displays  were  described  previously. 

Sequence :  Each  pilot  flew  each  experimental  condition  twice  on  each  of  two  days. 

Glide  slope:  A  6°  and  a  15°  glide  slope  were  used.  Since  initial-condition 
airspeed  is  a  function  of  glide  slope,  some  confounding  of  glide-slope  effects 
with  airspeed  effects  are  Inherent  in  the  experimental  design. 

Wind:  Wind  and  no-wind  conditions  were  randomly  presented.  Wind  velocity  was 
18  knots  and  wind  directions  were  randomly  presented  as  ±24°  with  reference  to 
the  the  localizer  course. 


Performance  Measures:  Fifty-five  objective  performance  measures  were  taken. 
Table  5  defines  these  measures  as  follows* 

Measure  1  is  time-to-capture,  where  capture  is  defined  arbitrarily 
to  occur  when  the  vehicle  remains  within  30Z  inner  bounds  of  both 
localizer  and  glide-slope  beams  for  a  minimum  of  10  sec. 

Measures  2  through  17  are  measures  of  absolute  glide  slope,  localizer, 
ground  speed,  and  sink-rate  error  at  four  points  along  the  glide  path, 

PI  through  P4  (see  definitions  at  bottom  of  table  5). 

Measures  18  through  41  are  measures  of  mean  position,  RMS  error  and 
RMS  variability;  for  glide  slope,  localizer,  ground  speed,  and  sink 
rate;  along  the  constant  speed  segment  (Const)  and  the  decelerating 
segment  (Decel)  (defined  at  bottom  of  table  4). 

Measures  42  through  47  are  measures  of  yaw,  pitch,  and  roll  RMS  varia¬ 
bility  along  the  constant  speed  and  decelerating  segments. 

Measures  48  through  55  are  measures  of  RMS  error  for  cyclic  and  col¬ 
lective  controls  and  rudder  pedal  movement  along  the  constant  speed 
and  decelerating  segments. 

Pilot  Opinion:  Pilot  opinion  and  ratings  were  obtained  from  the  17  questions 
in  table  6. 


Procedure 

Training;  The  three  commercial  pilots  did  not  have  UH-1  experience  and  were 
therefore  given  2  hours  of  training  on  the  UH-1  simulator  before  training  on 
the  experimental  displays.  This  training  consisted  of  flying  with  an  out- 
the-window  visual  scene  and  with  conventional  cross-pointer  presentations  of 
localizer  and  glide-slope  infozmation.  All  pilots  received  training  on  the 
experimental  displays  consisting  of  a  pictorial  briefing  to  ensure  knowledge 
of  display  element  functions  and  an  arbitrary  45  min  of  simulator  flight 
experience  with  each  display.  Pilots  were  not  trained  to  a  criterion  level. 

Instructions:  The  purpose  of  the  experiment  and  the  experimental  conditions 
were  explained  before  the  first  experimental  session.  Initial  conditions, 
aircraft  dynamics,  display  descriptions,  and  task  information  were  reviewed 
as  required  before  each  experimental  session  and  were  available  to  the  pilots 
on  briefing  sheets  at  all  times.  The  stated  task  was  to  "fly  the  vehicle 
from  the  initial  conditions  and  capture  the  localizer  and  glide-slope.  Fly 
down  the  approach  path  at  commanded  speed  (initial  constant  speed  during  the 
first  segment  of  the  approach  path,  and  commanded  deceleration  thereafter)." 

The  stated  task  performance  criteria  were  (1)  "minimum  glide-path,  localizer 
and  speed  errors"  and  (2)  "low  glide-path  and  localizer  capture  times." 

Pilots  were  informed  before  the  first  experimental  session  that  they  could 
decide  whether  the  force-feel  system  provided  on  the  cyclic  stick  and  tail 
rotor  pedals  was  activated  during  their  data  runs.  The  three  airline  pilots 
chose  to  disengage  the  force-feel  system  and  the  three  experimental  test 
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pilots  chose  to  engage  the  system.  Their  choices  were  apparently  based 
on  previous  experience. 

Data  Sessions;  During  each  of  two  data  sessions  for  each  pilot,  eight  data 
runs  were  made  for  each  of  three  displays. 

Data  Handling  and  Analysis:  Performance  data  were  recorded  on  magnetic  tape 
at  a  rate  of  20  points/sec.  An  analysis  of  variance  (ANOVA)  was  performed 
on  the  data  by  using  the  UCLA  Biomedical  Computer  Program  for  Factorial  Design 
(BMD08V) .  Table  7  shows  a  sample  analysis  for  one  of  the  55  dependent  measures. 


RESULTS 


Objective  Measures 

The  results  of  the  analysis  of  variance  indicate  large  variability  in  pilot 
performance.  Effects  were  accepted  as  significant  for  this  study  if  p  <_  0.05. 
Forty-three  of  the  55  performance  measures  were  significant  for  the  pilot 
factor.  The  detailed  analysis  was  confined  to  display  main  effects  and  display- 
glide  slope,  display-wind,  and  display-sequence  interactions.  Higher-order 
interactions  were  generally  not  significant  and  were  not  further  analyzed. 

Display  Main  Effects:  All  significant  display  main  effects  are  shown  in 
table  8.  The  patterning  of  significant  effects  is  shown  in  table  9.  For 
localizer  tracking,  four  of  the  six  measures  of  error  are  seen  to  be  signifi¬ 
cant:  absolute  error  at  P2,  P3,  and  P4;  and  RMS  error  over  the  constant  speed 
segment.  Table  9  also  shows  that  these  measures  consistently  order  display 
effectiveness.  Furthermore,  figure  10  indicates  that  the  two  nonsignificant 
measures  do  not  indicate  contrary  trends.  The  RAE  display  is  clearly  less 
effective  than  the  SAAB  and  TELDIX  displays  for  localizer  tracking.  The  SAAB 
display  appears  to  be  more  effective  than  the  TELDIX  display  for  localizer 
tracking. 

The  second  consistent  pattern  indicated  in  table  9  is  in  measures  of  RMS 
variability.  All  six  significant  measures  order  the  displays  in  effective¬ 
ness  as  follows:  SAAB,  RAE,  and  TELDIX.  Localizer  and  roll  variability 
measures  are  significant  for  both  the  constant  speed  and  decelerating  seg¬ 
ments,  while  sink  rate  and  yaw  measures  are  significant  only  over  the  con¬ 
stant  speed  segment.  Performance  sampled  by  these  RMS  variability  measures 
reflects  display  effectiveness  from  a  workload  and/or  systems  stability 
standpoint  rather  than  from  a  systems  accuracy  standpoint. 

The  TELDIX  display  was  most  effective  on  time  to  capture,  measure  1  with 
04  sec  as  opposed  to  76  sec  for  the  SAAB  display  and  103  sec  for  the  RAE 
display  (see  cell  means  in  table  8).  This  effect  is  discussed  further 
under  Interactions. 

Measure  53,  collective  stick  RMS  activity  over  the  decelerating  segment, 
indicates  an  effectiveness  order  of  RAE,  TELDIX,  and  SAAB.  It  is  speculated 
that  the  lesser  effectiveness  of  the  SAAB  display  results  from  the  lack  of 
an  artificial  horizon  indication  for  pitch  cues. 
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Ho  other  consistent  patterns  were  observed  in  the  main  effects. 

Interactions:  Display-sequence  interactions  were  generally  not  significant 
and  were  not  further  analyzed.  Significant  display-glide  slope  and  display- 
wind  interactions  are  plotted  in  figure  11. 

Time  to  capture  is  seen  to  have  a  display-wind  interaction  due  almost  entirely 
to  the  adverse  effect  of  wind  on  performance  with  the  RAE  display.  Wind  is 
also  seen  to  affect  the  localizer  mean  position  over  the  constant  speed  seg¬ 
ment  much  more  for  the  RAE  display  than  for  the  other  two  displays  (measure 
24).  Localizer  mean  position  over  the  decelerating  segment  is  also  affected 
by  glide-slope  angle  (measure  25) . 

The  large  localizer  tracking  errors,  the  long  time  to  capture,  and  the  adverse 
effects  of  wind  or  steep  glide  slope  all  imply  deficiencies  in  presenting  of 
lateral  guidance  information  in  the  RAH  display.  Although  the  SAAB  display 
permitted  the  best  localizer  tracking  of  the  three  presentations,  time  to 
capture  was  shortest  with  the  TELD1X  display,  possibly  because  of  the  rela¬ 
tively  conventional  cross-pointer  presentation  used  in  the  capture  process. 

Other  display-glide  slope  and  display-wind  interactions  plotted  in  figure  11 
provide  little  additional  information. 


Pilot  Opinion 

Cooper-Harper  ratings  assigned  to  the  three  displays  and  responses  to  the 
questionnaire  in  table  6  indicate  a  preference  for  the  RAE  display.  The 
TELDIX  display  was  least  favorably  regarded.  Tables  10  and  11  summarize 
the  favorable  and  unfavorable  comments  elicited  by  the  questionnaire  on  the 
RAE  and  SAAB  displays.  All  ratings  and  comments  on  the  TELDIX  display  were 
unfavorable  except  for  the  presentation  of  horizontal  position  information. 
Negative  responses  were  almost  invariably  stated  to  result  from  clutter 
associated  with  too  many  nearly  indistinguishable  straight-line  symbols 
clustered  at  the  center  of  the  display.  The  average  Cooper-Harper  ratings 
assigned  to  the  displays  by  the  six  pilots  were:  RAE,  3.2;  SAAB,  3.9;  and 
TELDIX,  6.5. 


CONCLUDING  STATEMENTS 


The  RAE  display  is  less  effective  than  the  SAAB  or  TELDIX  displa,  for  localizer 
tracking.  IMS  variability  measures  for  localizer,  roll,  sink  rate,  and  yaw 
tracking  imply  lower  pilot  workload  and/or  better  systems  stability  associated 
with  the  SAAB  display,  followed  (in  order)  by  the  RAE  and  TELDIX  displays. 

Time  to  capture  was  shortest  with  the  TELDIX  display  and  longest  with  the 
RAE  display.  Cooper  Harper  ratings  and  pilot  comments  favor  the  RAE  display 
over  the  SAAB  display;  this  ordering  is  at  variance  with  the  objective  per¬ 
formance  data.  Cooper-Harper  ratings  and  pilot  comments  ranked  the  TELDIX 
display  below  both  the  RAE  and  SAAB  displays;  this  ranking  is  supported  in 
part  by  RMS  variability  measures.  The  pilots  attributed  the  poor  performance 
with  the  TELDIX  display  to  extensive  central  clutter. 
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TABLE  1.  INITIAL  CONDITIONS 


Dimension 

6e  Glide  slope 

Y-offeet  (from  localizer),  ft 

600 

Heading  (to  localizer),  deg 

45 

X-range,  ft 

10,500 

Altitude,  ft 

900 

Airspeed,  knots 

60 

15s  Glide  slope 


TABLE  2.  GUIDANCE  EQUATIONS  FOR  DECELERATING  PROFILES 


Parameter 

* 

Equation 

v2 

8o 

Range  to  start  deceleration 

X  -  ■= - - - 

o  2a  cos  y 

Altitude  at  start  of  deceleration 

h  ■  X  tan  y 

o  o 

Commanded  ground  speed 

V  ■  (2a  x  cos  y)^2 

8c 

Ground-speed  error  displayed 

V  -  V  -  V 
e  g  gc 

a  is  constant  deceleration  (0.025g);  y,  desired  glide  slope; 

V  ,  ground  speed  at  start  of  deceleration;  and  X,  range  to  go 


TABLE  3.  EXPERIMENTAL  DESIGN 


Pilot 


Display 

RAE 

SAAB 

TELDIX 

6° 

15° 

Wh 

Wi 

Wi 

W 

m 

Typical 

WJ 

W 

n 

Wk 

W 

0 

SAAB 

TELDIX 

RAE 

TELDIX 

RAE 

SAAB 

TELDIX 

SAAB 

RAE 

RAE 

TELDIX 

SAAB 

SAAB 

RAE 

TELDIX 

TABLE  4.  PILOT  EXPERIENCE 


Pilot 


Total  flying  hours 


Fixed  wing  Helicopter 


600 

1600 

1150 

11850 

600 

5500+ 


Instrument  hours 


Fixed  wing  Helicopter 


UH-1 

hours 
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decelerating  data  segment;  P3,  end  of  decelerating 
data  segment;  P4,  last  point  measured  (low  speed,  near 
hover);  Const,  constant  speed  data  segment;  and  Decel, 
decelerating  data  segment. 


TABLE  6.  DISPLAYS  EVALUATION  QUESTIONNAIRE 


1.  Did  display  give  a  feeling  of  realism?  (Yes  or  No) 

2.  The  task  was  (easy,  a  little  difficult,  difficult)  to  learn. 

3.  The  workload  was  (low,  medium,  high)  after  learning  the  task. 

4.  Did  you  use  any  special  strategies? 

5.  Information  not  displayed  that  would  have  been  useful: _ 

6.  Information  displayed  that  was  not  needed: _ 

7.  Were  you  able  to  satisfactorily  distinguish  vertical  situation  information 

from  horizontal  situation  information?  (Yes  or  no;  explain  if  no) 

8.  Was  attitude  Information  adequate  (Yes  or  no;  explain  if  no) 

9.  Was  horizontal  position  Information  adequately  presented?  (Yes  or  no; 

explain  if  no) 

10.  Was  vertical  position  information  adequately  presented?  (Yes  or  no; 

explain  if  no) 

11.  Was  vertical  speed  information  adequately  presented?  (Yes  or  no;  explain 

if  no) 

12.  Did  the  display  use  any  confusing  symbology?  (Yes  or  no;  explain  if  yes) 

13.  Was  the  display  overly  cluttered  (busy)?  (Yes  or  no;  explain  if  yes) 

14.  Did  the  display  have  unsatisfactory  distracting  features  (movements, 

rotations,  etc.)?  (Yes  or  no;  explain  if  yes) 

15.  Did  display  adequately  handle  wind  conditions?  (Yes  or  no;  explain  if  no) 

16.  Please  comment  on  any  other  "good"  or  "poor"  features  of  the  displays. 

17.  Please  use  the  attached,  modified  Cooper-Harper  rating  scale  to  assign 

each  display  a  rating  between  1  and  10. 
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TABLE  7.  ANALYSIS  OF  VARIANCE  FOR  DEPENDENT  VARIABLE  1  (TIME  TO  CAPTURE) 


Source 

Error  term 

F 

Degree  of 
Freedom 

Mean  square 

1  Mean 

P 

172.1530 

1 

1898091 

2  P  (Pilot) 

R(PDSGW) 

9.0886 

5 

11025.60 

3  D  (Display) 

PD 

4.1381 

2 

37864.69 

4  S  (Sequence) 

PS 

.8950 

1 

2457.502 

5  G  (Glide  slope) 

PG 

29.5995 

1 

96332.75 

6  W  (Wind) 

PW 

60.4438 

1 

68951.31 

7  PD 

R(PDSGW) 

7.5427 

9150.199 

8  PS 

R (PDSGW) 

2.2633 

5 

2745.695 

9  DS 

PDS 

.2286 

2 

440.7803 

10  PG 

R(PDSGW) 

2.6828 

5 

3254.537 

11  DG 

PDG 

1.8487 

2 

3435.844 

12  SG 

PSG 

.2483 

1 

187.3125 

13  PW 

R(PDSGW) 

.9403 

5 

1140.750 

14  DW 

PDW 

5.3269 

2 

10342.50 

15  SW 

PSW 

.1771 

1 

214.7500 

16  GW 

PGW 

2.5796 

1 

486.2500 

17  PDS 

R (PDSGW) 

1.5896 

1928.365 

18  PDG 

R (PDSGW) 

1.5320 

1858.506 

19  PSG 

R (PDSGW) 

.6218 

5 

754.2671 

20  DSG 

PDSG 

1.9620 

2 

580.7188 

21  PDW 

R (PDSGW) 

1.6005 

1941.563 

22  PSW 

R (PDSGW) 

.9993 

5 

1212.280 

23  DSW 

PDSW 

1.6872 

2 

1329.219 

24  PGW 

R (PDSGW) 

.1554 

5 

188.5000 

25  DGW 

PDGW 

3.3288 

2 

3478.875 

26  SGW 

PSGW 

.3501 

1 

691.5000 

27  PDSG 

R (PDSGW) 

.2440 

295.9827 

28  PDSW 

R (PDSGW) 

.6494 

787.8076 

29  PDGW 

R (PDSGW) 

.8615 

1045.069 

30  PSGW 

R (PDSGW) 

1.6282 

5 

1975.208 

31  DSGW 

PDSGW 

.9962 

2 

1666.344 

32  PDSGW 

R(PDSGW) 

1.3788 

10 

1672.641 

33  R (PDSGW) 

144 

1213.120 

TABLE  8.  SIGNIFICANT  DISPLAY  MAIN  EFFECTS  (p  <  0.05) 
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Collective 


Favorable 


Unfavorable 


•  Feeling  of  realism  (A  pilots,  Ql*)  •  Ineffective  method  of  localizer 

•  Task  easy  to  learn  (A  pilots,  Q2)  tracking  (1  pilot,  Q9) 

•  Low  to  medium  workload  (6  pilots, 

Q3) 

•  No  confusing  symbology  (6  pilots, 

Q12) 

•  No  clutter  problem  (6  pilots,  Q13) 

•  Excellent  lead  information  in  pitch 

and  roll  (1  pilot,  Q16) 

•  Excellent  airspeed  management  dis¬ 

play  (1  pilot,  Q16) 

•  Modified  Cooper-Harper  rating:  3.2 

(average:  6  pilots,  Q17) 

• 

Indicates  response  by  four  pilots  to  question  1  in  table  6. 


TABLE  11.  PILOT  OPINION  OF  SAAB  DISPLAY 


Favorable 

Unfavorable 

•  Feeling  of  realism  (6  pilots,  Ql*) 

•  Task  easy  to  learn  (A  pilots,  Q2) 

•  Low  to  medium  workload  (5  pilots, 

Q3) 

•  No  clutter  problem  (6  pilots,  Q13) 

•  Modi tied  Cooper-Harper  rating: 

3.9  (average:  6  pilots,  Q17) 

•  Ground-speed  track  error  not  readily 

determinable  (1  pilot,  Q7) 

•  Pitch  attitude  information  inadequate 

(2  pilots,  Q8) 

•  Vertical  position  (glide  slope  and/or 

altitude  information)  inadequately 
presented  (3  pilots,  Q10) 

•  Reference  height  poles  confusing  (2 

pilots,  Q12) 

•  Airspeed  error  indicator  confusing  (2 

pilots,  Q12 

•  Outside-in  implementation  of  velocity 

vector  confusing  (1  pilot,  Q12) 

•  Vertical  response  of  velocity  vector  to 

pitch  attitude  too  sensitive  when 
close  in  (1  pilot,  Q12) 

•  Ground  speed  and/or  localizer  tracking 

adversely  affected  by  wind  (3 
pilots,  Q15) 

Fig.  2.  Modified  SAAB  perspective  display. 


Modified  TELDIX  hover  display 


Fig.  4.  Simulation  facility  . 
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Fig.  9.  Modified  TELDIX  display  —  showing  errors. 
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ABSTRACT 


Three  methods  of  displaying  a  discrete  time  series  are  compared.  One 
display  has  a  list  format  and  two  have  graphical  formats.  An  experiment 
where  subjects  estimated  the  mean  and  standard  deviation  of  a  time  series 
is  discussed.  In  the  sense  of  average  estimation  error,  it  is  shown  that 
the  display  with  the  list  format  yields  significantly  better  estimates  of 
the  mean  while  one  of  the  graphically  formatted  displays  yields  signifi¬ 
cantly  better  estimates  of  the  standard  deviation.  The  other  graphical  dis¬ 
play  is  shown  to  inherently  distort  the  standard  deviation  of  a  time  series. 
A  third  graphical  display  format  is  proposed  and  shown,  in  theory,  to  pro¬ 
vide  a  reasonable  compromise  between  the  advantages  and  disadvantages  of  the 
other  two  graphical  display  formats . 


INTRODUCTION 

Data  are  often  measured  at  discrete  points  in  time  rather  than  con¬ 
tinuously.  The  time  between  measurements  may  be  governed  by  the  sampling 
rate  of  the  measuring  device,  the  cost  of  measurements,  or  the  existence 
of  some  natural  sampling  period.  A  computer's  cycle  time  is  finite,  and 
thus,  it  cannot  sample  continuously.  The  cost  of  a  national  census  pro¬ 
hibits  frequent  measurements.  Stock  market  quotations  are  referred  to 
once  per  day  by  the  nonprofessional  invester  because  that  is  the  natural 
period  of  his  sampling  of  news. 

Regardless  of  the  reason,  the  human  is  frequently  faced  with  discrete 
time  series.  Based  on  the  information  in  the  time  series,  he  may  make  a 
decision  to  request  a  more  detailed  analysis  of  the  computer's  output,  per¬ 
form  a  check  on  the  data  collection  methods,  or  sell  his  shares  of  IBM  and 
buy  those  of  Dome  Mines.  While  the  information  that  he  perceives  in  the 
time  series  is  usually  not  the  only  data  on  which  he  bases  his  decision, 
it  certainly  is  often  a  motivating  force.  The  point  is  that  the  human  is, 
in  some  way,  affected  by  his  perception  of  various  characteristics  of  the 
time  series. 

There  are  a  variety  of  ways  in  which  to  display  a  discrete  time  series. 

A  very  elementary  display  is  a  simple  list  of  numbers  as  shown  in  Fig.  1. 

A  graphical  display  of  a  time  series  is  shown  in  Fig.  2.  Figure  3  illustrates 
a  display  similar  to  that  in  Fig.  2  except  that  the  dots  have  been  connected 
by  straight  lines.  The  question  addressed  by  this  paper  is  how  these  displays 
affect  human  performance. 

The  task  chosen  was  that  of  estimating  the  mean  and  standard  deviation 
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of  a  discrete  time  series.  A  knowledge  of  these  statistics  is  important 
to  various  data  manipulation  and  decision  making  techniques,  and  it  is  of 
interest  to  see  how  different  forms  of  presentation  affect  human  perception. 

Peterson  and  Beach  C 1 J 5 '  have  summarized  the  literature  on  human  per¬ 
ception  of  statistics.  They  conclude  that  the  human  is  a  good  estimator  of 
means.  Beach  and  Swenson  [2]  asked  subjects  to  estimate  the  mean  of  lists 
of  two  digit  numbers.  Subjects  did  very  well,  and  similarly  to  statistical 
formulas,  the  quality  of  their  estimates  improved  with  sample  size  and  de¬ 
graded  with  increasing  sample  variance. 

The  data  on  human  estimates  of  variability  are  less  conclusive  with 
some  data  indicating  over-estimation  and  other  data  indicating  underesti¬ 
mation  depending  on  the  emphasis  of  the  instructions  to  the  subjects  [1]. 
Lathrop  [3]  has  found  human  estimates  of  variability  to  be  related  to  the 
actual  mean,  standard  deviation,  and  sequence  effects. 

The  results  to  be  discussed  in  this  paper  have  implications  for  the  de¬ 
sign  of  display  systems.  Figures  2  and  3  represent  two  very  common  display 
formats.  The  lines  between  the  dots  are  usually  added  to  give  the  user  a 
better  feeling  for  patterns,  derivatives,  etc.  However,  it  will  be  shown 
that  such  a  display  inherently  distorts  the  statistical  nature  of  the  time 
series  and  that  this  distortion  is  transmitted  by  the  human  in  his  estimates 
of  the  statistics  of  the  time  series. 


THE  EXPERIMENT 

There  were  two  experimental  variables.  One  variable  was  display  type, 

Tp.  The  displays  illustrated  in  Figs.  1  through  3  will  be  termed  List,  Dot, 
and  Line,  respectively. 

The  second  variable  was  the  "true"  standard  deviation  Op  of  the  time 
series.  Three  values  of  a?  were  used  for  each  display  type.  Each  time  series 
was  60  units  in  length  and  represented  the  sum  of  three  periods  of  a  sine  wave 
and  white  noise  where  the  signal-to-noise  ratio  equalled  one. 

Three  replications  of  each  Tp-<Jp  combination  were  performed  making  for  a 
total  of  27  trials.  Replications  within  a  Tp-Op  combination  had  statistically 
similar  Op's  but  were  different  time  series. 

The  displays  were  generated  by  a  PDP-10  computer  and  output  on  377  by 
279  mm  computer  paper.  A  56-page  "book"  of  displays  was  generated  for  each 
subject.  The  first  page  of  the  book  briefly  described  the  experiment.  The 
second  page  was  blank  and  the  remaining  54  pages  presented  the  27  trials,  in 
a  different  random  order  in  each  book,  with  a  blank  page  between  each  trial. 

Eleven  students  in  a  senior/first-year  graduate  level  course  in  Operations 
Research  served  .  subjects.  The  experiment  was  performed  following  a  two-week 


“'Numbers  in  brackets  refer  to  entries  in  REFERENCES. 
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review  of  probability  and  statistics.  Thus,  the  subjects  were  well  aware 
of  the  concepts  of  mean  and  standard  deviation. 

The  subjects  all  sat  at  classroom  tables  with  their  "books"  in  front 
of  them.  On  the  first  page  they  read  the  following: 

"The  experiment  that  you  are  about  to  participate  in  has  been 
designed  to  test  your  visual  perception  of  statistics.  You  will 
look  at  three  types  of  displays. 

1.  A  list  of  numbers. 

2.  A  series  of  dots. 

3.  A  series  of  dots  connected  by  lines. 

Your  task  is  to  estimate  the  mean  (average)  and  standard  deviation 
(plus  and  minus  one  std.  dev.  about  the  mean  includes  68%  of  the 
points),  for  a  type  1  display,  you  should  write  down  the  numerical 
value  of  the  mean  and  standard  deviation.  However,  for  display 
types  2  and  3,  you  need  only  make  marks  on  the  page  indicating  where 
you  think  the  mean  and  plus  and  minus  one  std.  dev.  are". 

The  experimenter  then  explained  each  type  of  display  on  the  black¬ 
board.  He  discussed  how  one  might  find  the  distribution  of  a  time  series 
by  drawing  equally-spaced  lines  parallel  to  the  time  axis  and  counting  the 
number  of  dots  falling  in  each  interval. 

Based  on  questions  from  the  subjects,  the  procedure  was  changed  somewhat 
from  that  described  above.  For  a  Type  1  (List)  display,  the  subjects  wrote 
down  the  mean  and  those  numbers  which  they  felt  represented  plus-  and  minus- 
one  standard  deviation.  They  did  not  actually  estimate  the  standard  deviation. 

It  was  explained  to  the  subjects  that  they  would  have  20  seconds  per  trial 
to  make  their  estimates.  They  were  told  to  estimate  the  mean  first  and  then 
the  standard  deviation  with  respect  to  the  mean.  The  experiment  started  with 
the  experimenter  saying  "turn"  whereupon  each  subject  turned  the  page  of  his 
book  to  look  at  the  first  trial.  After  15  seconds,  the  experimenter  said 
"write"  and  each  subject  indicated  his  estimates  on  the  page.  After  five 
seconds,  the  experimenter  again  said  "turn"  and  the  subjects  went  to  the  next 
trial.  This  20-second  turn/write  cycle  repeated  until  all  27  trials  were  com¬ 
plete. 

The  experiment  was  forced-paced  in  this  nature  to  avoid  having  subjects 
agonize  over  the  decisions  or  attempt  to  actually  calculate  the  statistics. 

In  realistic  tasks,  estimation  of  statistics  is  often  a  minor,  subconscious 
activity  leading  to  some  larger  goal.  Thus,  the  subjects  had  to  be  constrained 
from  giving  more  attention  to  their  estimates  than  they  would  in  such  realistic 
tasks . 


RESULTS 

The  subjects'  estimates  are  compared  with  the  "true"  statistics  in 
Tables  I  and  II.  The  true  statistics  were  calculated  using: 
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Table  I  Estimates  of  the  Mean 


Display 


1 


3 


LIST 

0 


08/16. 6 1mm* 
38/  1.03** 


-1.62/18.77 
-0.30/  2.22 


4.46/22.39 
0.16/  2.46 


DOT 


.  .2/  7.36 
~  99/  2.56 


7.95/  8.93  10.17/13.00 

0.20/  0.98  1.04/  4.34 


LINE 


8.27/  5.65 
-0.03/  2.03 


6.62/10.89  5.89/12.36 

-2.41/  1.64  -2.86/  0.86 


Mcan/Standard  Deviation  of  nstir  ate 


Table  II  Estimates  of  the  Standard  Deviation 


12  3 


LIST 

19 . 26/8. 81mm* 

35.94/14.64 

38.14/23.34 

25.45/0.93** 

40.23/  1.81 

52.66/  1.38 

DOT 

22.55/6.24 

36.88/  7.14 

49.78/13.54 

24.31/1.79 

38.07/  2.80 

53.46/  0.66 

LINE 

20.84/5.54 

32.30/  9.88 

42.26/12.36 

24.68/0.77 

39.02/  2.07 

50.24/  6.17 

Mean/Standard  Deviation  of  Estimate 


*Eleven  subjects  times  three  replications 
*Trte  statistics,  three  replications. 
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A  complete  analysis  of  variance  of  the  estimation  errors  showed  that 
Ox  was  not  a  statistically  significant  factor  in  estimating  means.  However, 
the  display-subject  interaction  in  the  mean  estimates  and  the  o^-display- 
subject  interaction  in  the  standard  deviation  estimates  precluded  further 
conclusions  from  the  complete  analysis. 

Thus,  a  breakdown  analysis  by  subjects  was  performed.  This  analysis 
showed  that  display  effects  were  statistically  significant  for  about  one-half 
of  the  subjects.  0^.-display  interaction  was  significant  for  about  one-fourth 
of  the  subjects. 

Looking  at  the  estimation  error  distribution  across  subjects ,  it  was  found 
that  List  displays  yielded  significantly  better  estimates  of  the  mean  than  Dot  and 
Line  displays.  The  errors  with  Dot  and  Line  displays  were  not  significantly 
different  for  estimates  of  the  mean.  However,  while  the  average  errors  with 
tb j  List  displays  were  significantly  better,  the  standard  deviations  of  the 
errors  were  large.  Perhaps  this  is  due  to  subjects  differing  greatly.  A 
reason  for  this  might  be  that  some  subjects  quickly  calculated  the  average  of 
a  few  elements  of  the  time  series  to  make  their  estimates  of  the  mean  while 
other  subjects  did  (as  they  were  told)  and  simply  put  down  the  estimate  they 
perceived  without  any  explicit  calculating. 

The  consistently  positive  average  errors  and  low  variance  (relative  to 
List  )  of  errors  when  esJ  .■'macing  the  mean  with  Dot  and  Line  displays  may  have 
resulted  because  9  of  .  subjects  were  right-handed.  However,  the  data  are 
too  limited  to  supporJ  .is  conclusion. 

Dot  displays  yielded  significantly  better  estimates  of  the  standard 
deviation  than  List  or  Line  displays.  The  errors  with  List  and  Line  displays 
were  not  significantly  different  for  estimates  of  the  standard  deviation. 

While  Dot  and  Line  did  not  yield  significantly  different  results  for 
estimates  of  the  means,  they  did  yield  significantly  different  results  for 
estimates  of  standard  deviation.  This  motivated  the  calculation  of  the  mean 
and  standard  deviation  for  each  of  these  displays.  For  the  Dot  display, 

Eqs.  (1)  and  (2)  were  used.  For  the  Line  display,  the  statistics  were  cal¬ 
culated  by  integrating  the  piecewise  continuous  functions  as  follows: 


Calculating  these  statistics  for  the  27  time  series  that  were  used,  it 
was  found  that  mean  was  not  significantly  different  between  displry  types  but 
that  the  standard  deviation  with  the  Line  display  was  significantly  lower  than 
that  with  the  Dot  display.  Thus,  the  Line  display  distorts  the  standard  de¬ 
viation  of  a  discrete  time  series. 
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If  the  subjects'  Line  display  estimates  of  standard  deviation  are  ad¬ 
justed  by  adding  the  average  amount  that  the  statistics  are  distorted  by  con¬ 
necting  the  dots,  it  is  found  that  the  estimates  with  Dot  and  Line  displays 
are  no  longer  significantly  different.  This  leads  one  to  conclude  that 
humans  perform  equally  well  (in  this  task)  with  either  display,  but  that 
the  Line  display  is  inferior  because  of  an  inherent  defect  in  the  format. 

In  an  Appendix  of  this  paper,  the  expected  values  of  statistics  cal¬ 
culated  from  connected  dot  displays  are  derived.  The  cases  of  linear  and 
quadratic  interpolation  are  considered.  It  is  shown  that  either  type  of 
interpolation  yields  unbiased  estimates  of  the  mean.  However,  the  dots 
connected  with  straight  lines  yielded 

2 

EU2(tn  =  E(x2)  ♦  (pXi  - 1)  (5) 

and  the  dots  connected  with  parabolas  yielded 
_  a2 

E[x2(t)]  =  E(x2)  +  -i  (4p  "  Pv  v  -  3)  (6) 

15  x.  x.+1  Xi  x.+2 

where 


Interpreting  Eqs.  (5)  and  (6),  p  equals  one  yields  unbiased  statistics,  L  't 
such  a  value  for  p  is  not  very  realistic.  As  p  decreases  to  zero,  the  bias 
increases  unitl,  at  p  equals  zero,  the  bias  of  Eq.  (5)  is  almost  70  percent 
greater  than  that  of  Eq.  (6).  The  actual  bias  in  the  standard  deviation  is 
dependent  on  the  value  of  the  mean.  Equations  (5)  and  (6)  give  lower  bounds 
on  the  bias. 

•  •  •  s in  x 

Higher  order  interpolations,  perhaps  -  for  a  large  number  of  points, 

will  yield  progressively  better  estimates  of14 statistics.  However,  the  law  of 
diminishing  returns  will  certainly  come  into  play  as  the  number  of  points  in¬ 
creases  and  one  should  consider  whether  or  not  the  savings  will  be  worth  the 
programming  and  execution  time  included  in  generating  such  a  display. 


The  subjects'  average  error  in  estimating  the  standard  deviation  with 
the  Dot  display  was  5.7  percent  while,  with  the  Line  display,  the  average  was 
16.2  percent.  Based  on  the  calculations  in  the  Appendix,  it  can  be  shown 
that,  for  the  zero-mean  time  series  in  this  experiment,  Eq.  (5)  yields,  at 
most,  an  18.4  percent  average  error  in  estimating  the  standard  deviation. 

This  is  not  signif icantly  different  from  16.2  percent.  Equation  (S)  yields, 
at  most,  a  10.5  percent  average  error  in  estimating  the  standard  deviation. 
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If  it  is  assumec  that  the  human  would  make  a  corresponding  improvement ,  and 
it  Is  further  assumed  that  the  human  estimation  error  will  asymptotically 
approach  5.7  :  cent  as  the  number  of  points  used  in  the  interpolation  in¬ 
creases  to  infinity,  then  it  could  be  claimed  that  a  display  incorporating  a 
three-point  interpolation  scheme  removes  approximately  43  percent  of  the  error 
that  it  is  possible  to  remove  and  still  retain  the  advantages  of  a  connected 
dot  display. 

It  is  impressive  that  such  a  small  change  yields  such  a  significant  re¬ 
sult.  However,  the  designer  of  display  schemes  has  several  factors  tc  con¬ 
sider.  He  would  have  to  be  willing  to  accept  the  assumptions  of  the  previous 
paragraph  and  feel  that  the  experimental  task  used  here  closely  resembles  the 
expected  use  for  the  display  that  he  is  designing.  Also,  he  would  have  to 
determine  whether  or  not  estimation  of  statistics  will  be  a  significant  com¬ 
ponent  of  that  task. 

As  a  final  note  on  the  types  of  displays  considered  in  this  paper,  the 
List  display  caused  much  more  variability  than  the  other  displays  for  both 
types  of  estimation.  Before  adopting  such  a  display  (perhaps  for  estimating 
means)  one  should  consider  the  cost  of  the  variability  of  error  as  well  as 
the  average  error. 


CONCLUSIONS 

Three  displays  have  been  compared — one  with  a  list  format  and  two  with 
graphical  formats.  Experimental  data  have  been  used  to  show  that  subjects 
estimate  the  mean  of  a  time  series  better  with  the  list  format  and  estimate 
the  standard  deviation  better  with  one  of  the  graphical  formats  (Dot).  The 
other  graphically  formatted  display  (Line)  was  shown  to  be  inferior  because 
it  inherently  distorted  statistics  and  not  because  of  a  human  limitation.  It 
Was  shown,  in  theory,  that  quadratic  interpolation  will  remove  approximately 
40  percent  of  the  estimation  error  that  it  is  possible  to  remove  and  still 
retain  the  advantages  of  a  connected  dot  display. 

Whenever  a  human  is  performing  a  task  where  estimation  of  statistics  is 
a  significant  part  of  the  task  (even  if  only  implicitly),  the  results  pre¬ 
sented  in  this  paper  should  be  taken  into  account.  The  format  of  the  display 
may  be  as  important  as  the  statistics  of  the  time  series  and  the  researcher 
or  designer  should  try  to  avoid  choosing  a  format  that  unnecessarily  degrades 
performance . 
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APPENDIX 


The  Statistics  of  Connected  Dots 


A.  Straight  Lines 


The  equation  of  a  straight  line  between  the  points  (x^,t^)  and  (x2,t2)  is 

x(t)  =  xl  +  (t~'~  t^)  (t  ~  V  (A1) 

If  the  process  x(t)  is  stationary  and  ergodic,  then  the  mean  and  mean-square 
are  given  by 


x<t>  =  1  /X(t)  dt 


(A2) 


2,  .  lim  1  /*  2 , 

x  <*>  =  T  -  oo  t  J  x  (t)  dt 


(A3) 


For  the  piecewise  continuous  function  defined  by  N  -  1  straight  lines  con¬ 
necting  N  points  x  ,x  , ***,x  ,  assuming  t . +1  -  t.  =1,  x(t)  and  x2(t)  can  be 
shown  to  be  1  n  11  1 


x(t) 


N  -  1 


(X1  +  X2)  (XN-1  +  V 

- - -  f  •  •  •  +  - - - 


(A4 ) 


x2(t)  =  1 


N  -  1 


2  A  A  2»  ,  2  ^  2,- 

(xl  +  X1  X2  +  V  .  .  (XN-1  +  XN-1  XN  +  XN 

- - -  +  •  •  •  +  - 


(A5 ) 


Taking  the  expected  values  of  Eqs.  (A4)  and  (A5), 
E[x(t )]  =  E(x), 

E[x2(t)]  =  |  E(x2)  +  j  x.  x.+1 
Define  the  correlation  function  p..  as 


x.  x. 
1  1 


X. 

1 


X. 


3 


X  . 

3 


(A6) 

(A7) 


(AS ) 


Since  x(t)  is  stationary 


X.  X.  -  X 

3  =  _ 

x.x, 

1  j  °x2 


Substituting  (A9)  into  (A7), 


2  2  °x2 

E[x^(t)]  =  E(x^)  +  (p  -  1). 

3  x.  x.„ 
l  l+l 


(A10) 


Thus,  connecting  the  dots  with  straight  lines  yields  an  unbiased  estimate 
of  the  mean  and  a  biased  estimate  of  the  standard  deviation. 


B.  Quadratic  Lines 

The  rquation  of  a  parabola  that  goes  through  the  three  points  (x  ,t  ), 
(x2,t2),  and  (*3,t3)  is  1  1 

(x3  "  xl)  (x3  "  2x  +  x  ) 

x(t)  =  x2  +  - - -  (t  -  t2)  +  - - -  (t  -  t2)2  tx  <_  t  <  ■ 

(All) 

where  it  is  again  assumed  that  t^+j_  -  t^  =  1.  For  the  piecewise  continuous 
function  defined  by  (N  -  l)/2  parabolas  connecting  N  points,  where  N  is  odd, 
(A2)  and  (A3)  can  be  shown  to  yield 

-  1  fxi  +  4x„  +  x  x  +  4xM  +  xu~] 

X(t)  =  - f - —  +  ***  +  3  H-1  H,  (A12) 


1  2  2 


X  (t)  =  N^TU5  (2X1  +  2xl  x2  +  8x2  '  X1  x3  +  2x2  X3  +  2X3}  +  *' 


2  2 


+  15*  (2xN-  2  +  2xN-2  XN-1  +  8Vl  -  xN-2  Xn  +  2xN-l  xn  +  2V 


(A13) 


(A14 ) 


(A15) 


Taking  the  expected  values  of  (A12)  and  (A13), 
E[x(t )]  =  E(x) , 

Substituting  (A9)  into  (A15) 


E[x2(t)]  =  E(x2)  +  (4p  x<  -  p  -  3).  (A16 ) 

l  l+l  xi  xi+2 
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ABSTRACT 


Simulation  experiments  are  being  conducted  to  investigate  realistic  alternatives 
to  the  centralized,  ground-based  ATC  system  with  nearly  complete  computerization 
of  human  decision  making  projected  for  1985  and  beyond.  The  experiments  involve 
three  pilots  flying  simulated  STOL  craft  and  two  professional  approach  controllers 
simultaneously  managing  a  terminal  traffic  problem  of  a  total  of  five  A/C  (including 
two  747’s)  all  within  10  nm  of  touchdown  at  the  problem  start.  The  problem  re¬ 
quires  the  3  STOL  A/’C  to  merge  between  the  two  747’s  and  all  five  A/C  to  cross 
an  approach  point  1-1/2  nm  away  from  the  runway  at  30  sec  spacing.  Seven  vari¬ 
ations  of  distributed -centralized  control  are  being  investigated  based  on  three  levels 
of  ground  responsibility  (vectoring,  sequencing  only,  advisory  only)  and  four  levels 
of  pilot  CRT  information  which  combines  traffic  situation  displays  and  30  sec  tactical 
path  predictors. 

A  number  of  measures  are  used  to  compare  the  safety,  expeditiousness,  order¬ 
liness  and  workloads  of  the  flights  such  as;  average  crossing  rate,  minimum  spac¬ 
ing,  stick  and  throttle  activity,  verbal  communication  etc.  Except  for  the  vector¬ 
ing  case,  the  pilots  fly  in  an  "electronic  VFR"  environment  because  of  the  traffic 
displays  in  the  cockpits. 

This  report  presents  several  initial  findings.  Specifically  -  spacing  was  main¬ 
tained  closer  to  a  specified  value  and  with  less  variance  in  non  vectoring  modes, 
and  in  general,  vectoring  did  not  produce  better  performance  than  the  non  vectoring 
modes.  Predictors  did  not  produce  any  large  improvement  in  the  measures  so  far 
analyzed  although  their  presence  was  clearly  preferred  by  pilots.  Pilots  favored 
vectoring  least  while  controllers  preferred  it  most.  The  group  (pilots  and  control¬ 
lers)  preferred  a  moderate  division  of  responsibility  (sequencing)  in  which  predic¬ 
tors  were  displayed  on  the  traffic  situation  displays. 

The  suggestion  is  made  that  with  a  moderate  division  of  responsibility,  control¬ 
lers  could  handle  units  of  aircraft  while  the  pilots  manage  the  individual  aircraft 
of  a  unit  in  a  distributed  responsibility  management  mode. 
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INTRODUCTION 


The  "Alexander  Report"^  is  now  fairly  familiar  to  those  interested  in  air  traf¬ 
fic  control  systems.  That  report  outlined  the  state  of  "crisis"  in  aviation  in  terms 
of  present  and  projected  future  demand  loads  on  the  system  (considering  that  several 
present  airports  such  as  JFK,  LGA  already  experience  heavy  corgestion  and  delays 
during  weather  conditions  and  peak  hours),  new  aircraft  types  and  the  human  work 
force  in  the  system.  Projections  were  made  for  a  four-fold  increase  in  aviation 
traffic  and  a  ten-fold  increase  in  demand  for  ATC  service  by  1995.  While  envi¬ 
ronmental  and  financial  factors  have  reduced  these  projections,  it  would  obviously 
be  unsafe  to  count  on  them  as  solutions  to  the  problem  of  providing  the  ATC  sys  - 
terns  necessary  for  the  future. 

The  terminal  ATC  system  (as  of  1973)  is  still  essentially  a  manual  operation 
which  provides  separation  service,  sequencing,  spacing,  navigation -approach  guid¬ 
ance  and  information  service  by  employing  controllers,  radio  communications  ra¬ 
dar  and  navigation  aids.  Increased  demand  on  the  system  produces  increased 
workloads  for  the  controllers  and  requires  increased  controller  workforce.  How¬ 
ever,  attempting  to  solve  the  growing  demand  problem  by  utilizing  a  growing  con¬ 
troller  workforce  is  inherently  self-limiting  with  the  present  highly -centralized 
philosophy  for  terminal  ATC.  As  more  sectors  are  added  to  the  terminal  airspace 
to  keep  a  low  aircraft  density  (and,  therefore,  low  responsibility  load)  in  each  sec¬ 
tor,  the  controller's  workload  due  to  aircraft  hand-offs  at  each  sector  boundary 
increases  because  of  the  decreasing  amount  of  time  spent  in  a  sector  by  an  aircraft. 
In  addition,  as  aircraft  density  increases  so  do  the  collision  opportunities. 

Ingredients  for  future  ATC  systems  which  can  accommodate  the  projected  de¬ 
mands  and  minimize  controller/ pilot  workloads  have  centered  heavily  about  im¬ 
proved  instrumentation  and  automation  (particularly  computer  automation).  For 
example,  the  Third  Generation  ATC  System  (1960-1980)  is  semi -automated  in 
relieving  the  controller  of  much  clerical  work  by  printing  flight  progress  strips 
automatically,  etc.  and  generally  improving  coordination  of  activities  while  still 
leaving  basic  decision-making  to  the  human  controller.  New  information  display 
systems  (ARTS  III,  ARTS  II)  for  controllers  are  also  being  introduced  as  part  of 
this  generation. 

An  upgraded  third  generation  system  (1975-1995)  was  begun  in  1969  to  improve 
the  3rd  generation  system  and  these  two  should  merge  in  the  early  1980's.  The 
upgraded  third  generation  is  a  fairly  radical  departure  in  at  least  two  ways. 

Much  of  the  present  human  decision-making  and  planning  are  to  be  automated,  and 
introduction  of  onbo«rd  CRTS  and  computers  (specifically  area  navigation  equip- 
ment-RNAV^  )  could  allow  the  pilot  to  assume  a  greater  responsibility  in  total 
air  traffic  control. 

Even  with  the  introduction  of  these  two  possibilities  it  is  clear  that  the  upgraded 
third  generation  system'3'  in  1980  will  still  be  man-intensive  and  ground -central¬ 
ized  with  the  controller  continuing  radar  vectoring  in  medium  and  high  density  traffic. 
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Automation  will  assist  the  controller  in  metering  and  spacing  aircraft  and  perhaps 
in  conflict  prediction  and  resolution.  There  will  be  a  shift  to  data -link  communi¬ 
cation  (isolating  pilots  from  the  general  picture  on  "party  line"  where  ATC  sys¬ 
tem  errors  are  often  caught)  and  to  airborne  area  navigation  with  self-contained 
airborne  navigation  systems  of  improved  accuracy. 

Some  research  has  already  been  directed  to  the  human  factors  aspects  of  the 
upgraded  third  generation  system.  For  example.  Air  Traffic  Situation  Displays 
(ATSD)  which  were  proposed  several  decades  ago  have  recently  been  tested  in 
simulations  for  their  value  as  a  pilot  assurance  device^)  to  offset  the  potential 
hazards  due  to  pilot  isolation  via  data  link  communications.  With  an  ATSD  the 
pilot  is  assured  of  normal/abnormal  sequence  of  events,  his  landing  slot  and  ade¬ 
quate  safety  margins  with  respect  to  other  aircraft.  It  was  found  that  an  ATSD 
did  contribute  to  traffic  awareness  and  did  decrease  controller  workload.  The 
simulated  ATC  system  remained  ground  (controller)  centered. 

Division  of  Responsibility  -  Distributed  Management 


The  upgraded  third  generation  system  is  assumed  to  be  completed  by  the  end 
of  the  century  at  which  time  the  fourth  (or  "advanced")  generation  system  will  have 
been  in  development  since  approximately  1985.  This  advanced  generation  system 
has  not  yet  been  fully  detailed  although  implementation  is  expected  to  begin  in  the 
early  1980's.  Although  again  a  highly  automated  system  (including  human  plan¬ 
ning  and  decision  making)  is  a  basic  assumption  for  the  advanced  system  there  is 
a  great  concern  regarding  the  actual  implementation  of  automation  of  the  human 
intellectual  and  executive  components  of  the  system.  Quotes  from  a  recent  pub¬ 
lication  may  suggest  some  of  this  concern-.^) 

"The  fundamental  issue  is  whether  we  pursue  automation  programs  with  the 
goal  of  removing  the  pilot  (and  the  controller)  from  the  command -response  cir¬ 
cuit,  or  with  the  goal  of  providing  him  with  information  on  his  aircraft's  perform¬ 
ance,  its  position,  both  geographical  and  in  relation  to  other  traffic,  and  the  sta¬ 
tus  of  on-board  and  ground-based  systems  important  to  the  conduct  and  safety 
of  his  flight.  The  air.Une  pilots  strongJy  support  the  latter  view.  " 

And  with  regard  to  automating  aircraft  guidance.and  control  by  (e.  g. )  coupl¬ 
ing  information  directly  from  ground  to  the  autopilot'  ,  the  same  writer  continues: 

"Transferring  this  responsibility  to  government  personnel  on  the  ground  will 
never  be  acceptable  to  pilots  and  I  strongly  doubt  that  the  government  is  ready  to 
assume  (the  )  liability  that  accompanies  this  responsibility.  " 

The  question  of  controller/pilot  responsibility  in  future  ATC  system  is  a 
pivotal  one(7); 

"Perhaps  the  single  most  decisive  conceptual  question  to  be  answered  is  the 
extent  to  which  traffic  management  in  the  system  should  be  distributed  between 
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the  pilot  and  controller.  Should  the  pilot  be  able  to  play  an  active  part  in  the 
traffic  management  process  or  just  a  passive  role? 

"The  number  one  human-factor  problem  in  moving  forward  into  future  Air  Traf¬ 
fic  Control  System  design  is  that  of  controller/ pilot  responsibility.  Behavior  of 
the  Man  in  the  system  must  be  given  high  priority.  " 

"Human  factor  considerations,  such  as  those  relating  to  controller  and  pilot 
responsibility,  may  comprise  the  basis  for  the  most  difficult  problems  to  solve 
in  the  development  of  an  advanced  air  traffic  management  system.  " 

There  has  been  several  recent  examinations  of  this  issue  of  pilot/controller 
division  of  responsibility.  Litchfordf  suggests  that  there  be  an  appropriate 
balance  of  cockpit  and  ground  control  emphasizing  perhaps  a  greater  future  share 
of  track  and  schedule  keeping  for  the  pilot.  He  points  out  that  instrumentation  in 
the  cockpit  could  allow  the  pilot  to  completely  execute  a  flight  track  and  schedule 
non-conflicting  tracks  so  that  the  ground  need  only  monitor  execution  of  the  pre¬ 
planned  track  and  schedule.  He  cautions,  as  have  others,  that  the  pilots  should 
not  become  controllers.  It  is  not  clear  now  even  what  the  division  of  responsi¬ 
bility  is  to  be.  Litchford  also  suggests  the  use  of  air-to-air  and  air-to-ground 
signalling  to  balance  controller /pilot  responsibilities  along  with  precision  RNAV 
in  the  cockpit. 

Anderson,  et  al,^)  performed  a  simulation  experiment  using  a  pilot  and  an 
ATC  "system  manager.  "  Basically,  a  computer  generated  a  sequence  schedule 
for  several  aircraft  and  a  4-dimensional  (space -time)  flight  path  which  was  up- 
linked  to  a  graphical  aircraft  situation  display  for  the  pilot.  The  display  con¬ 
tained  actual  and  desired  aircraft  positions  and  alphanumeric  data.  The  pilot's 
primary  role  was  to  execute  the  (computer -generated)  4-D  flight  path,  verify  the 
data  and  monitor  other  aircraft  in  their  flight  paths.  The  ground  controller 
(relieved  of  the  major  workload  of  radar  vectoring)  would  insure  correctness  of 
the  computer  generated  flight  paths,  monitor  execution,  participate  during  emer¬ 
gencies  by  direct  communication  and  control  over  the  computer.  In  this  experi¬ 
ment,  perfect  conditions  were  simulated  and  the  pilot  had  to  maintain  his  4-D 
position  to  touchdown.  No  other  requirement  was  placed  on  him  or  investigated. 

The  test  was  primarily  one  of  computer  sequencing,  path  generation  and  pilot 
execution.  No  pilot-ground  interaction  was  reported  so  that  the  controller's 
(verbal)  workload  was  small  or  non  existent.  No  pilot-pilot  interaction  was  possi¬ 
ble.  The  pilot  did  in  fact  execute  the  preplanned  flight  path  correctly. 


The  above  experiment  suggests  that  the  pilot  could  be  replaced  by  an  autopilot 
following  up-linked  4-D  computer  generated  flight  paths.  This  concept  is  being 
investigated  by  several  workers^^^^  and  it  seems  superficially  capable  of  im¬ 
plementation.  At  present  this  concept  demands  a  very  highly  centralized  ground- 
based  system  and  the  earlier  quotations  may  be  recalled. 


Interactive  Traffic  Management 


The  basic  problem  and  question  of  interest  as  mentioned  previously  is  the  ex¬ 
tent  to  which  traffic  management  can  be  partitioned  between  ground  and  air  using 
the  capabilities  offered  by  present  and  future  cockpit  resources  such  as  CRT  for 
rapidly  displayed  and  assimilated  visual  information;  o.i  board  computers  for  se¬ 
lected  data  processing  and  storage;  air-borne  sensors  for  inputting  environmental 
conditions;  air-to-air  data  exchange  of  information  such  as  strategic  (long  range 
e.  g.  flight  paths)  and  tactical  (short  range  -  e.  g.  path  predictors)  predictions; 
air-to-ground  and  air-to-air  exchange  of  qualitative  and  quantitative  information; 
air-to-ground  data  exchange  channels. 

These  as  well  as  future  advances  in  cockpit  capabilities  coupled  with  the  natural 
human  decision  making  abilities  present  in  the  highly  motivated  and  skilled  aircraft 
crew  define  a  collective  *esource  for  alternative  approaches  to  traffic  management 
which  should  be  considered. 

The  traffic  situation  display  forms  the  nucleus  for  thinking  related  to  division 
of  responsibility.  Anderson,  Curry  et  al^2)  suggest  that  the  rule  structure  for 
instrument  flight  rules  (IFR)  flying  could  be  modified  by  utilizing  the  ATSD  as  a 
type  of  electronic  VFR  (visual  flight  rules)  since  the  pilot  has  potentially  complete 
information  on  the  location  of  surrounding  aircraft.  In  this  use,  -*ie  ATSD  could 
also  increase  the  number  of  aircraft  landed  per  unit  time  by  reducing  the  present 
IFR  separation  standards  (3nm  at  present  except  for  a  light  aircraft  following  a 
"heavy"  at  the  same  or  lower  altitude  in  which  case  4  or  5  nm  is  required  for  the 
following  aircraft)  by  having  the  pilot  act  as  a  monitor  and  control  agent.  The 
pilot  for  instance  could  simply  be  requested  to  trail  at  a  commanded  distance  the 
aircraft  ahead  of  him  (visible  on  the  ATSD).  This  suggestion  allows  the  possi¬ 
bility  of  interactive  traffic  management  between  the  human  element  in  the  air  ¬ 
craft  and  that  on  the  ground.  They  did  not,  however,  give  any  precise  details. 

In  fact  no  clear  details  exist  as  to  how  an  interactive  traffic  management  would 
operate.  The  United  States  Aviation  Advisory  Commission  defined  "distributed 
air  traffic  management"  as  "a  system  in  which  the  ground  controller  is  responsible 
for  overall  traffic  flow,  routing  and  monitoring,  while  the  individual  pilot  is  re¬ 
sponsible  for  navigation,  station  keeping  and  collision  avoidance  in  conformance 
with  an  approved  flight  plan.  " 

Because  of  the  lack  of  definite  experiments  in  the  area  of  interactive  traffic 
management  on  which  to  base  further  conjectures  and  because  of  the  need  to  ex¬ 
amine  alternatives  to  the  strongly  (ground)  centralized  highly -automated  proposals 
for  future  ATC  systems  the  experiments  described  here  were  begun  at  NASA -Ames 
Research  Center  in  the  Man-Machine  Integration  Branch  during  1973. 

EXPERIMENTS  IN  INTERACTIVE  TRAFFIC  MANAGEMENT 


Research  Objectives 


The  objectives  of  the  research  were  to  determine  the  extent  to  which  individual 


aircraft  as  a  group  in  conjunction  with  ground  based  control  could  participate  in 
managing  their  local  traffic  situation  in  the  terminal  area.  This  management  in¬ 
volved  sequencing,  flight  path  planning  and  execution  and  spacing  to  insure  a  safe, 
orderly  and  expeditious  operation  of  terminal  traffic.  Because  there  was  little 
practical  experimental  information  in  this  particular  area  of  interactive  ATC,  the 
initial  research  was  to  be  in  the  nature  of  probes  to  uncover  sensitive  areas  and 
delimit  potential  applications.  Specific  research  items  included: 

1)  Measurement  criteria  for  successful  traffic  management. 

2)  Type  of  visual  displays  and  verbal  communication  networks 
most  conducive  to  interactive  management. 

3)  Role  of  prediction  (anticipatory)  elements  in  the  traffic 
management  concept. 

4)  Rule  structures  required. 

5)  Group  decision  making  capabilities. 

Research  Purpose 

The  purpose  of  the  research  was  primarily  to  investigate  realistic  alternatives 
to  the  highly  centralized  ground  based  ATC  and  computerization  of  high  level  hum¬ 
an  decision  functions  now  being  projected  for  future  terminal  air  traffic  manage¬ 
ment.  Specific  objections  to  proposed  plans  are: 

1)  Highly  centralized,  ground-based  control  does  not  seem  to  utilize 
effectively  a  large  portion  of  the  resources  existing  in  the  sys¬ 
tem  -  specifically  the  human  decision  making  capabilities  in  the 
coclpit  enhanced  by  the  onboard  computers,  CRT  displays  and 
information  exchange  possibilities  present  or  planned  for  future 
aircraft.  In  addition,  crew  members  are  both  capable  and 
de3irous  of  increased  traffic  management  participation. 

2)  Centralized  structures  suffer  from  difficulties  in  responding 
rapidly  in  an  efficient  adaptive  manner  to  meet  unexpected 
changes.  Large  amounts  of  data  are  required  by  centralized 
controls  to  deal  with  local  perturbations. 

3)  It  is  extremely  difficult  to  automate  higher  human  decision 
processes  or  functions.  This  is  particularly  true  when  vague 
criteria  are  operative.  The  future  controller  force  size  is 
based  upon  projected  traffic  density  and  effective  computer¬ 
ization  of  their  decision  making  ability.  The  work  force  must 
be  increased  past  projections  if  the  software  realizations  do 
not  materialize. 

4)  /here  is  no  guarantee  that  the  projected  automation  software 
algorithms  can  be  achieved. 
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Requirements  of  all  future  systems  are  that  they  be  safe,  orderly  and  exped¬ 
itious. 


Task  Description 

The  task  used  to  compare  alternative  concepts  was  arrived  at  following  initial 
testing  of  several  problems  such  as  following  in  trail  over  a  considerable  distance, 
merging  at  an  initial  approach  fix  and  trailing,  etc.  These  were  rejected  basical¬ 
ly  because  of  a  too  specific  nature.  The  adopted  task  incorporates  a  number  of 
aspects  which  can  be  studied  such  as  form-up,  sequencing,  spacing,  orderliness, 
etc. 

The  basic  task  required  that  three  aircraft,  flown  in  simulated  flight  by  pro¬ 
fessional  pilots,  be  inserted  between  two  scheduled  aircraft  on  a  3°  glide  slope 
initially  separated  at  5  nm.  (The  two  scheduled  aircraft  flights  are  computer 
generated. )  A  map  defining  the  task  as  projected  onto  the  ground  path  is  shown 


Figure  1  Ground  Projection  of  the  Task  Layout 

The  task  is  terminated  for  each  aircraft  when  it  crosses  the  middle  marker  because 
adequate  visual  displays  for  the  descent  to  touchdown  were  not  incorporated  into 
this  simulation.  Initial  headings  and  X,  Y  positions  and  velocities  of  the  three 
piloted  aircraft  were  randomly  assigned  at  the  start  of  each  run.  Initial  altitude 
for  the  three  was  always  3000  ft.  Eighteen  initial  positions  (and  matching  speeds) 
were  possible.  Positions  were  precalculated  ensuring  that  the  task  could  in  fact 
be  done  within  the  capabilities  of  the  simulated  craft.  The  controllers  could  issue 


only  speed  commands  to  the  two  computer  aircraft  via  a  TTY  (INFOTON)  key¬ 
board  operational  throughout  the  experiment. 


The  task  was  a  fairly  reasonable  problem  in  which  the  three  piloted  aircraft 
could  be  considered  of  a  STOL  type  while  the  two  (CTOL)  independent  computer 
aircraft  were  considered  as  747.  The  two  independent  craft  provided  beginning 
and  ending  time  constraints  which  required  group  interaction  to  solve  the  insertion 
problem.  Each  run  required  approximately  5  minutes  to  complete. 

Division  of  Responsibility  and  Display  Information 

Three  different  divisions  of  responsibility  for  executing  the  task  and  four  dif¬ 
ferent  information  displays  were  investigated  as  shown  in  the  paradigm  in  Figure  2. 


Figure  2  The  Seven  Alternatives  Investigated  in  the  Experiment. 

Assurance  Displays  were  not  Investigated. 

The  MAPS  displays  differ  first  in  the  presence  or  absence  of  other  aircraft  in  addi¬ 
tion  to  the  pilot's  own  and  secondarily  in  the  presence  of  30  sec.  path  predictors 
on  "own"  or  on  all  aircraft.  The  ATC  responsibility  is  either  central  (represented 
by  usual  radar  vectoring  of  the  piloted  STOLS)as  one  extreme  or  distributed  in  which 
either  an  air-centered  concept  is  used  as  the  other  extreme  where  the  controller 
may  only  advise  the  STOLS)or  a  moderate  division  in  which  ground  is  responsible 
for  issuing  sequencing  (order)  instructions  (e.g.  "number  3  follow  number  1") 
and  advisorys.  More  definite  rules  for  each  of  the  three  ATC  possibilities  were 
supplied  to  the  subjects  in  an  initial  briefing  and  during  practice.  (Appendix) 

The  area  of  assurance  displays  was  not  investigated  because  of  previous  re¬ 
search  ^  already  reported.  Thus  a  total  of  seven  different  conditions  were  in¬ 
vestigated. 


Pilots  always  saw  their  own  aircraft  on  the  map  and  controllers  were  aware 
of  this  and  acted  accordingly.  For  instance  a  pilot  could  be  requested  to  "inter¬ 
cept  the  ILS.  "  An  eighteen  knot  north  wind  always  blew  horizontally  and  straight 
down  the  ILS  approach  line. 

Task  Objectives 

Task  objectives  were  defined  for  the  subjects.  Several  of  these  are  outlined 
here. 

1)  Aircraft  (A/C)  4  must  cross  the  middle  marker  first.  A/C  5 
should  cross  last.  (4  &  5  are"747's"  on  a  3°  approach).  Both 
should  cross  at  120  KTS. 

2)  A/C  1,  2,  3  (piloted)  should  be  on  a  6°  glide  slope,  120  KTS, 

0° heading,  on  the  ILS  when  crossing  the  iddle  marker. 

3)  Desired  spacing  of  all  A/C  crossing  the  middle  marker  is  30  sec. 

(or  1  nm  -  ground  projection  at  120  KTS  ground  speed).  Avoid 
spacing  less  than  30  sec. 

4)  Piloted  A/C  (1,  2,  3)  must  not  descend  below  4°  glide  slope. 

5)  Minimize  throttle  changes,  maneuvering  etc. 

Subjects  were  instructed  to  treat  the  problem  as  realistically  as  possible. 

Because  the  "STOLS"  were  on  a  6°  glide  slope  once  on  the  ILS  approach  line 
and  hence  well  above  the"747's",  no  wake  turbulence  spacing  was  required  for 
them  although  the  "heavies"  (A/C  4  &  5)  remained  approximately  5  nm  apart  on 
their  3°  glide  slope. 

Measures 


A  number  of  measures  were  defined  which  would  give  information  relative  to 
assessing  alternatives  on  the  three  global  concerns  of  safety,  orderliness  and 
expeditiousness  and  local  concerns  such  as  pilot  and  controller  workloads,  pas¬ 
senger  comfort,  fuel  economy,  etc.  Data  points  were  stored  on  each  run  so  that 
the  measures  could  be  derived  after  the  experiment.  At  the  present  time  five 
measures  are  available  for  making  comparisons,  throttle  movements,  final  lat¬ 
eral  error,  final  heading  error,  final  glide  slope  error  and  temporal  spacing 
crossing  the  middle  marker.  In  addition,  questionnaires  were  distributed  to  the 
subjects  after  the  experiment  asking  them  to  rank  order  alternatives  on  their  own 
preference  scales.  Some  of  this  reduced  information  is  given  in  this  report. 

Tape  recordings  were  made  of  voice  communications  for  analysis  which  will 
be  given  in  later  reports. 

Subjects  were  also  requested  to  fill  out  sheets  after  each  run  for  their  quali¬ 
tative  assessments  of  workload  and  other  factors. 
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Displays 


Figure  3  shows  a  CRT  display  for  one  of  the  piloted  A/C.  The  glide  slope  in¬ 
dicator  assumes  a  conical  6°  cone  centered  on  the  touchdown  point  and  thus  curved 
approaches  could  be  flown.  The  glide  slope  information  is  computed  from  altitude 
and  range  from  touchdown.  The  upper  lefthand  numerics  indicate  per  cent  of  thrust 
from  30%{stall  at  60  KTS)  to  100%(200  KTS).  Altitude  in  feet  and  sinkrate  in  ft/min 
are  given  by  the  upper  right  hand  numerics.  Center  numerics  show  heading  in 
degrees.  The  map  display  can  be  selected  by  each  pilot  to  show  either  a  transla¬ 
ting  map  (A/C  centered,  map  north  up)  or  a  rotating  map  (A/C  centered,  A/C 
north  up).  The  map  scale  could  be  selected  by  each  pilot  as  1"  =  1.5  nm  or  1"  = 

1/2  nm.  Figure  3  shows  the  translating  map  and  the  1.  5  nm/inch  scale. 

The  controller's  traffic  display  was  essentially  the  same  as  the  map  shows  in 
Figure  2.  The  controller's  display  covered  a  10"  x  10"  area,  while  the  pilot's 
was  a  5"  x  10"  display.  The  2  nm  radius  range  rings  were  generally  dimmed  by 
pilots  and  controllers  until  they  were  just  visible.  No  predictors  were  ever 
shown  on  the  controller's  display  since  they  are  of  limited  or  no(^)(14)  use. 

All  graphic  displays  were  made  by  an  Evans  and  Sutherland  Line  Drawing  Sys¬ 
tems  in  conjunction  with  an  SEL  840  digital  computer. 


The  controllers  used  an  additional  CRT  display  which  showed  flight  information 
for  the  5  aircraft  displayed  in  the  format  below: 
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The  aircraft  list  order  always  remained  the  same  and  only  altitude,  heading  and 
speed  changed.  Commanded  (not  necessarily  actual)  heading  appeared  under  HDG. 
This  information  was  entered  by  one  controller  following  a  verbal  request  to  a 
particular  aircraft  by  the  traffic  controller.  Heading  on  A/C  4  and  5  could  not  be 
changed.  The  speed  of  4  and  5  was  under  direct  controller  control  and  the  speed 
of  these  craft  gradually  approached  commanded  speed.  Thus  they  could  not  be 
speeded  up  or  slowed  down  instantaneously.  Any  commands  (alt  tude,  heading, 
speed)  to  aircraft  1,  2,  3  had  to  be  carried  out  by  the  pilots.  As  an  aircraft 
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crossed  the  middle  marker  its  flight  information  would  vanish  from  the  display 
and  when  it  crossed  the  farthest  end  of  the  runway  lines,  its  symbol  would  vanish 
from  all  traffic  displays.  Controller  entered  infamdion  would  first  appear  in  the 
scratch  area  of  the  display  and,  if  acceptable,  it  was  entered  by  an  appropriate 
key.  A  very  rigid  and  simple  entry  format  was  used.  Aircraft  number  (1-5) 
followed  by  A  or  H  or  S  followed  by  the  appropriate  numerics.  If  a  syntatical 
error  were  made,  the  scratch  area  blinked  and  ERROR  appeared  requiring  re¬ 
entry  from  the  keyboard.  Controllers  were  generally  satisfied  with  this  display 
and  data  entry  format. 

Subjects,  Instructions,  Protocol 


Figure  4  is  a  montage  of  the  three  pilots  and  two  controllers  who  together 
formed  a  team  throughout  the  experiment.  Three  separate  teams  have  been  eval¬ 
uated  to  date  with  professional  commercial  airline  pilots  and  practicing  profess¬ 
ional  approach  controllers  serving  as  subjects. 

Prior  to  a  team's  participation,  each  member  received  a  six  page  set  of  in¬ 
structions,  objectives  etc.  describing  the  experiment.  (These  pages  are  repro¬ 
duced  in  the  Appendix.)  The  sheets  were  distributed  during  the  first  briefing 
period  and  any  questions  answered.  A  one  page  questionnaire  directed  toward 
the  written  information  was  then  filled  out  by  each  subject  to  test  his  understand¬ 
ing  of  the  material.  The  correct  answers  were  read  aloud  and  any  mistakes  noted 
and  discussed.  Pilots  and  controllers  were  then  taken  to  their  stations  and  given 
individual  explanations  of  the  equipment.  The  practice  day  was  then  started  and 
twenty-one  runs  covering  the  seven  conditions  were  given  with  intervening  rest 
periods.  A  briefing  was  held  following  the  practice  period  and  the  test  question¬ 
naire  again  distributed.  Answers  were  read  and  any  mistakes  noted  and  dis¬ 
cussed. 

The  experiment  was  then  completed  on  two  days.  One  trial  and  two  test  runs 
of  the  vectoring  condition  were  given  to  start  the  first  test  day  and  to  end  the  sec¬ 
ond  test  day.  Three  different  conditions  were  tested  on  each  day.  One  trial  and 
four  test  runs  of  each  condition  were  made.  Thus,  each  condition  received  one 
trial  and  four  test  runs  except  vectoring.  Pilots  and  controllers  assumed  the  same 
stations  throughout  practice  and  test  days. 

Preliminary  Results 

At  the  present  time  five  measures  have  been  analyzed  from  the  seven  differ¬ 
ent  conditions  tested  on  three  separate  subject  teams.  These  are  reported  below. 

Quantitative  Data 

Table  I  shows  the  mean  values  and  standard  deviations  for  five  measures  - 
final  lateral  error,  final  heading  error,  final  glide  slope  error  (these  were  mea¬ 
sured  when  the  aircraft  crossed  the  middle  marker  temporal  spacing  crossing 


the  marker  and  total  number  of  throttle  movements. 


TABLE  I 

MEANS  AND  STANDARD  DEVIATIONS  FOR  FIVE  MEASURES 
TAKEN  DURING  THE  DISTRIBUTED  RESPONSIBILITY  EXPERIMENTS 
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The  measures  were  taken  only  on  the  three  piloted  simulators.  Spacing  was 
measured  by  the  times  between  the  crossing  aircraft  and  the  one  preceding  it. 

The  task  of  inserting  three  aircraft  between  the  two  scheduled  ones  was  completed 
successfully  in  all  test  runs.  The  data  in  Table  I  are  organized  to  compare  the 
seven  separate  conditions  (ATC  x  MAPS);  the  ATC  conditions  separately  (Vector, 
Sequence,  Advise);  the  three  MAPS  used  under  Sequence  and  Advise  (No  Pre¬ 
dictor,  Own  Predictor,  All  Predictors)  and  finally  predictors  (No  predictor. 
Predictor).  Table  II  shows  the  results  of  a  statistical  analysis  ^  '  to  test  the 
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effects  of  predictors  -  vs-  no  predictors  and  the  three  ATC  conditions  (V-S-A) 
on  mean  values  of  the  five  measures.  F -rations  and  degrees  of  freedom  are  given 
in  the  table. 


TABLE  II 


F-RATIOS 
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Table  II  shows  that  there  is  a  significant  difference  (t>  <  .  05)  in  spacing  be¬ 
tween  vectoring.  Sequencing  and  Advisory  ATC  conditions.  Figure  5  is  a  plot 
of  the  spacings  which  indicates  the  vectoring  condition  resulted  in  a  greater 
average  spacing  (39.  4  sec.)  (requested  spacing  v:as  30  sec. ). 
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Figure  5  Means  and  Standard  Deviations  for  Spacing  Crossing 
the  Middle  Marker.  Requested  Spacing  was  30  sec. 
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Sequencing  and  Advisory  conditions  had  essentially  the  same  spacings  (36  sec. ) 

The  standard  deviation  of  the  spacings  in  Vectoring  (6.  3  sec. )  also  appears  greater 
than  for  the  non-vectoring  conditions  (3.76  sec.)  and  this  difference  is  statistic¬ 
ally  significant  (p  <  .01).  Table  I  also  suggests  that  the  standard  deviation  of  the 
spacing  for  Sequence  is  greater  than  for  Advisory  which  is  also  confirmed  (p<  .05) 
as  are  those  differences  for  predictors  -  no  predictors  (in  Sequence  and  Advisory) 

(p<.  01). 

There  were  no  significant  differences  in  average  number  of  throttle  movements 
(12.  8)  although  the  standard  deviations  of  the  movements  for  no  predictors -predictors 
were  significant  (pc.  01).  Throttle  movements  were  defined  as  a  5  knot  or  greater 
change  in  throttle  setting. 

Lateral  errors  (grand  average  of  25.  4  meters)  were  not  significantly  different 
nor  were  heading  errors  (grand  average  of  0.  65  degrees).  However,  the  stand¬ 
ard  deviations  of  lateral  error  were  different  when  predictor -r.o  predictor  values 
were  compared  (pc.  05). 

When  vectoring.  Sequencing  and  Advisory  ATC  conditions  were  compared  re¬ 
garding  final  glide  slope  errors,  no  significant  differences  were  found  in  the  mean 
values  (0. 166  degrees),  but  use  of  the  predictors  resulted  in  a  slightly  larger 
glide  slope  error  than  not  using  predictors  in  Sequence  and  Advisory  (pc.  05). 
Likewise,  the  slide  slope  error  variance  was  greater  with  predictors  (pc.  01)  than 
without. 

Heading  error  variance  was  slightly  smaller  when  using  predictors  in  Sequence 
and  Advisory  (pc.  01). 

Qualitative  Data  -  Pilot,  Controller  Replies 

The  subjects  were  requested  to  rank  order  each  of  the  seven  conditions  after 
the  experiment  was  completed  by  their  team.  Responses  from  nine  pilots  and 
four  (out  of  six)  controllers  were  gathered  and  the  average  rank  for  each  alterna¬ 
tive  was  computed.  Figure  6  shows  the  average  rank  for  each  basic  condition, 
for  the  three  ATC  conditions,  and  for  the  predictor  conditions  in  Sequence  and 
Advise.  These  rankings  are  shown  for  pilots  and  controllers  separately  and 
both  together. 

The  pilots  preferred  vectoring  least  and  Sequencing  most  with  Advisory  close 
to  vectoring.  Controllers  preferred  Vectoring  most  and  Advisory  least.  Se¬ 
quencing  is  clearly  preferred  to  Advisory  by  both  pilots  and  controllers.  Of 
the  seven  conditions,  Advisory  with  no  predictors  was  least  preferred  by  both 
pilots  and  controllers.  Sequencing  with  predictors  would  be  the  group  prefer¬ 
ence.  Sequencing  with  t  predictors  and  Advisory  with  predictors  were  pre¬ 
ferred  essentially  equally  by  both  pilots  and  controllers.  Predictors  were  clearly 
preferred  to  no  predictors  by  both  pilots  and  controllers  with  only  a  slight  pre¬ 
ference  for  predictors  on  all  aircraft  as  opposed  to  on  own  aircraft  only.  Statis¬ 
tical  analyses  of  this  preference  data  will  be  given  in  later  reports. 
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Figure  6  Average  Rank  Order  Preference  for  each  of  the 
Seven  Conditions  (ATC  x  MAPS)  expressed  by 
Pilots  (P),  Controllers  (C),  and  the  Total  Group  (T) 
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Although  analysis  of  the  verbal  data  has  not  begun  yet,  anecdotal  results 
suggest  that  the  Controllers'  verbal  workload  was  much  higher  in  Vectoring  than 
in  Sequencing  or  Advisory.  Pilots'  verbal  workload  in  Sequence  and  Advisory 
did  not  seem  comparable  to  that  of  the  controllers  in  Vectoring.  Typically  in 
Sequence  there  was  an  initial  amount  of  verbal  instructions  to  the  pilots  followed 
by  little  or  no  exchange  from  then  on.  In  Advisory,  some  controller  teams  kept 
up  a  constant  stream  of  advisory  information  (e.g.  "traffic  at  2  o'clock,  2500  feet") 
Actual  management  verbal  activity  was  low  by  both  pilots  and  controllers  in  Se¬ 
quence  and  Advisory. 

DISCUSSIONS  &  CONCLUSIONS 

The  most  obvious  finding  of  this  initial  analysis  is  that  the  controllers'  pre¬ 
ferences  for  the  three  divisions  of  responsibility  directly  reflect  their  increasing 
responsibility  in  management.  The  pilots  on  the  other  hand  appear  to  prefer 
least  a  highly  air  centered  and  a  highly  ground  centered  division  (about  equally) 
while  preferring  the  more  moderate  division  in  which  controllers  issue  initial 
sequence  (i.  e.  order)  for  the  aircraft  leaving  the  pilots  the  remainder  of  respon¬ 
sibility  for  flight  path  planning,  spacing  etc.  The  pilots  prefer  a  predictor,  at 
least  on  their  own  aircraft  in  this  mode. 

Spacing,  which  is  a  global  (system)  concern,  seems  to  be  done  better  in  either 
the  Sequencing  or  Advisory  mode.  Not  only  is  the  mean  spacing  closer  to  the  re¬ 
quested  value  of  thirty  seconds  but  the  variance  is  smaller  as  well.  From  queuing 
theory  it  is  known  that  the  variance  as  well  as  the  mean  value  of  "service  time" 
determines  the  average  queue  length  such  that  the  smaller  the  variance,  the  smaller 
the  "stack-up".  The  spacing  variance  in  the  Vector  condition  was  twice  as  large 
as  for  Sequencing  and  four  times  as  large  as  for  Advisory.  However,  while  the 
average  spacing  was  smaller  (but  not  significant)  using  predictors,  the  variance 
was  larger.  This  is  somewhat  counter  to  previous  studies^16)  which  show  that 
predictors  tend  to  reduce  variances  particularly  among  subjects. 

Table  I  suggests  that  as  spacing  becomes  more  accurately  controlled  (smaller 
mean  and  variance)  the  number  of  throttle  movements  increase  slightly  which  would 
be  reasonable. 

There  was  no  difference  between  Vectoring,  Sequencing  and  Advisory  on  any 
of  the  measures  except  spacing  from  which  one  can  conclude  that  for  this  parti¬ 
cular  task.  Sequencing  (a  moderate  division  of  responsibility)  could  be  an  accept¬ 
able  alternative  to  Vectoring  based  on  pilot  and  group  preferences,  improved  spac¬ 
ing  accuracy  and  (potentially)  reduced  spacing  variability,  and  lack  of  evidence  that 
Vectoring  produced  any  superior  performances. 

There  was  some  confounding  in  the  experiment  in  that  the  Vectoring  condition 
never  displayed  other  aircraft  to  the  pilots  (assurance  displays).  This  could  change 
the  preference  (subjective)  ratings  but  it  is  unlikely  it  could  change  the  spacing 
(objective)  results. 
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Predictors  on  "own"  or  all  aircraft  were  clearly  preferred  even  by  the  con¬ 
trollers  who  could  not  see  them  on  their  display  but  were  aware  of  their  chaiacter- 
istics  from  initial  explanations  and  watching  the  pilots'  displays  during  briefing 
sessions  Paradoxically,  the  only  clear  evidence  of  a  predictor  related  average 
performance  difference  was  a  slight  but  statistically  significant  (.04  degrees) 
increase  in  glider  slope  error.  Likewise,  the  error  and  spacing  variances  seemed 
to  increase  with  predictors.  Since  the  predictor -no  predictor  comparisons  were 
made  only  in  the  non  vectoring  conditions,  it  is  difficult  to  attribute  these  perform¬ 
ance  decrements  to  the  increased  responsibility  (workload).  It  is  expected  that 
throttle  movements  would  increase  with  predictors  displayed  since  they  provided 
tactical  feedback  on  which  adjustment  could  readily  be  made  and  assessed.  It  is 
not  clear,  however,  why  spacing  variance  should  be  larger  with  predictors.  A 
possible  explanation  is  that  predictors  added  a  certain  amount  of  "clutter"  to  the 
display  such  that  tendencies  toward  more  accurate  spacing  possible  with  predictors 
were  somewhat  offset  by  display  confusion.  The  "clutter"  possibility  .s  suggested 
by  the  smaller  standard  deviation  of  "own"  predictor  compared  to  all  predictors  in 
the  Sequencing  and  Advisory  modes.  This  difference  is  significant  at  the  5%  level 
while  the  difference  in  average  spacing  is  not  significant. 

Since  there  was  a  strong  preference  for  having  predictors  displayed,  it  must 
be  assumed  that  the  pilots  have  some  need  for  them  even  though  the  measures  ana¬ 
lyzed  so  far  do  not  reflect  this.  It  could  be  conjectured  that  predictors  displayed 
on  other  aircraft  provide  tactical  information  as  to  their  intentions  and  thus  act 
at  least  as  assurance  elements  to  a  pilot  while  the  pilot's  own  predictor  is  useful 
in  spacing  and  timing  functions.  Controllers  may  also  feel  assured  of  the  pilots' 
ability  to  manage  some  of  the  traffic  situations  knowing  that  they  have  this  tacti¬ 
cal  information  and  can  respond  to  it.  Clearly  tactical  information  of  this  short 
range  (30  sec.  )  is  not  useful  directly  to  controllers  as  demonstrated  by  other  work^13^ 
and  previous  trials  to  this  set  of  experiments. 

The  experimental  results  thus  far  suggest  that  a  fairly  expeditious  flow  of  traf¬ 
fic  can  be  managed  without  unrealistic  workloads  for  controllers  or  pilots  by  allow¬ 
ing  the  pilots  a  considerable  participation  in  the  overall  management. 

Other  measures  such  as  closest  spacing,  trail  stability,  amount  of  maneuver¬ 
ing,  aircraft  roll  and  pitch  accelerations  etc.  are  being  analyzed  in  order  to  contin¬ 
ue  comparisons  between  the  experimental  conditions.  An  attempt  will  be  made  to 
compare  objectively  the  alternatives  on  the  overall  (subjective)  criterion  of  order¬ 
liness  by  using  fast  time  playbacks  of  recorded  ground  tracks  and  multidimensional 
scaling  techniques  based  on  the  subjective  evaluations.  It  is  possible  for  example 
that  the  presence  or  absence  of  predictors  may  have  an  effect  on  the  perceived 
orderliness  of  the  flights. 

POSSIBILITIES  FOR  IMPLEMENTATION 

None  of  the  experimental  alternatives  assumed  anything  more  than  existing  or 
slightly  state-of-the-art  engineering. CRT's  and  onboard  computers  are  presently 
available.  Suitable  air-air  or  air-ground  data  links  are  already  in  the  planning 
phases  at  least.  For  example,  the  predictors  were  based  on  present  bank  angle 
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and  air  speed.  An  onboard  computer  is  clearly  capable  of  computing  and  dis¬ 
playing  one's  own  predictor.  A  predictor  from  another  aircraft  could  also  be 
computed  and  displayed  from  similar  information  broadcast  in  a  suitable  code 
from  that  aircraft.  If  a  high  (several  times/sec)  data  rate  is  not  anticipated  it  is 
posable  that  state  parameters  from  which  an  efficient  model  of  the  other  aircraft 

could  be  made  and  the  predictions  "filled  in"  between  transmissions  could  also  be 
sent. 

In  a  mode  such  a  Sequencing  with  either  "own"  or  all  predictors  displayed  and 
with  sufficient  experience  such  that  controllers  are  in  fact  assured  of  airborne 
human  decision  making  and  execution  functioning,  the  total  management  strategy 
could  be  markedly  different.  High  volumes  of  traffic  could  be  managed  safely, 
expeditiously  and  in  an  orderly  manner  with  acceptable  controller  workloads  by 
having  a  controller  handle  several  aircraft  organized  as  a  unit  raiher  than  indi¬ 
vidual  aircraft.  He  would  rely  upon  the  elements  of  the  group  to  manage  their 
local  traffic  situation  with  minimal  controller  input.  Thus  future  concepts  would 
revolve  around  ground-based  centralized  control  of  the  units  with  a  distributed 
management  within  each  unit.  The  size  of  a  unit  would  be  variable  from  one  (an 
individual  aircraft)  co  several  depending  upon  aircraft  capability  and  intentions. 
Future  experiments  should  be  addressed  to  this  concept  and  its  ramifications. 

SUMMARY 

Preliminary  results  were  reported  from  an  experiment  in  three  alternatives 
for  pilot/controller  division  of  responsibility  in  managing  terminal  approach  air 
traffic.  The  problem  required  that  three  piloted  simulator  aircraft  be  inserted 
onto  a  fi°  glide  slope  between  2  computer  aircraft  on  a  3°  glide  slope  such  that 
the  aircraft  cross  a  middle  marker  on  an  ILS  every  thirty  seconds.  Three  di¬ 
visions  of  responsibility  were  defined:  Vectoring,  Sequencing  (controller  issues 
order,  Instructions  and  advisories  only)  and  Advisory  (controller  issues  advis¬ 
ories  only).  Pilots  had  Air  Traffic  Situation  Display  (ATSD)  with  or  without 
predictors  except  in  the  Vectoring  mode  in  which  only  their  own  aircraft  was 
visible  on  the  ATSD.  No  difference  in  mean  performance  could  be  found  for  five 
measures  analyzed  so  far  except  for  temporal  spacing  in  which  the  two  non-vec¬ 
toring  modes  were  superior  both  in  average  spacing  and  in  reduced  spacing  vari¬ 
ability.  Vectoring  was  preferred  first  by  the  controllers  and  last  by  the  pilots 
who  preferred  Sequencing  first  and  Advisory  second.  Pilots  (and  controllers) 
preferred  predictor  displays  to  no  predictor  displays  in  Sequencing  and  Advisory. 

A  suggestion  was  made  that,  by  using  a  distributed  responsibility  such  as 
Sequencing,  future  terminal  traffic  management  could  be  based  upon  units  of  air¬ 
craft  handled  as  entities  rather  than  individual  aircraft. 
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ABSTRACT 

Pilot/vehicie  describing  function  measures  were  obtained  for  a  five- 
degree  -of-  freedom  simulated  air-to-air  tracking  task  at  high  angle  of  attack 
and  zero  and  non-zero  sideslip.  The  task  is  representative  of  a  situation 
in  which  the  aircraft  is  near  stall  yet  the  pilot  is  attempting  to  maintain 
track  without  inducing  aircraft  departure.  Non-zero  sideslip  is  quite  common 
for  such  flight  situations  and  results  in  a  controlled  element  having  highly 
coupled  lateral-longitudinal  dynamics . 

Highly  skilled  experimental  flight  test  pilots  were  thoroughly  trained 
in  the  stall/departure/recovery  aspects  of  the  simulation.  Describing  function 
measures  were  then  obtained  for  multiloop,  pitch,  roll,  and  heading  tracking 
tasks  at  selected  pre-departure  frozen  conditions .  The  crossover  model  was 
found  to  be  valid  for  each  loop  closure.  The  precision  pilot  model  provided 
an  excellent  fit  to  the  data  except  that  in  pitch  the  crossover  was  close  to 
the  longitudinal  short-period  mode  and  required  the  pilot  to  adopt  a  second- 
order  lead  equalization  approximately  the  inverse  of  the  longitudinal  short 
period.  The  gain  and  low-frequency  lag-lead  equalization  employed  in  the  roll 
loop  closure  was  found  to  differ  depending  upon  whether  the  roll  loop  was  an 
outer  (roll  tracking)  or  inner  (heading  tracking)  loop.  Coupling  between  the 
airframe  lateral  and  longitudinal  dynamics  was  found  to  increase  the  pilot 
workload  but  did  not  appreciably  affect  the  equalization  employed. 


SIMULATION 

The  fixed-base  simulation  approximated  an  air-to-air  tracking  tail-chase 
as  depicted  in  Fig.  1  .  A  head-up  display  was  employed  with  a  symbol  repre¬ 
sentative  of  own-aircraft  (boresight)  centerline  fixed  at  the  center  of  a  TV 
screen.  The  target  and  horizon  moved  with  respect  to  this  own-aircraft  bore- 
sight.  The  head-up  field  of  view  was  i2b  deg  azimuth  and  ±1 8  deg  elevation. 


*This  work  was  accomplished  under  Contract  F536l  5-75-C-31  01  for  the  Air 
Force  Flight  Dynamics  Laboratory,  Wright -Patters on  AFB,  Ohio. 

t Principal  Research  Engineer  and  Senior  Research  Engineer,  respectively. 


The  subject  aircraft  could  be  maneuvered  in  bank,  pitch,  and  heading  relative 
to  the  target  (cp^,  Op^,  i^at)  sustained  deviations  would  result  in  lateral 
or  vertical  displacement  with  respect  to  the  target .  Only  range  to  target 
remained  fixed  at  2000  ft.  The  subject  aircraft  pitch  and  roll  attitude  could 
be  discerned  with  respect  to  the  horizon  (q>g,  AOg) .  To  partly  compensate  for 
the  lack  of  lateral  acceleration  cue,  a  replica  of  the  ball  of  the  turn  and 
slip  indicator  was  also  displayed  on  the  TV  screen. 

The  subject  aircraft  was  modeled  by  a  nonlinear,  five-degree-of- freedom, 
coupled  lateral-longitudinal  representation  as  indicated  by  the  equation  flow 
diagram  of  Fig.  2.  In  addition  to  inertial  terms,  the  equations  included 
kinematic  and  aerodynamic  coupling  terms  which  result  from  sideslip.  Thus, 
for  the  handling  quality  portion  of  the  investigation,  the  aircraft  dynamics 
varied  with  a  and  3,  and  realistic  stall  and  nose  slice  departure  character¬ 
istics  were  obtained. 

The  measurement  of  pilot  describing  functions  with  the  DFA  requires  a 
linear,  stationary  control  process.  Therefore,  the  airframe  dynamics  were 
"frozen"  for  the  data  runs.  This  was  accomplished  by  fixing  all  airf-  ime 
stability  derivatives  at  the  value  appropriate  for  the  given  trim  condition 
and  aircraft  configuration  (i.e.,  the  derivatives  were  not  allowed  to  vary 
with  a  and  3) .  Three  trim  configurations  representative  of  impending  stall 
and  departure  were  employed  (Table  l).  The  base  configuration  (A)  assumed 
symmetric  flight  (3=0)  and  hence  had  uncoupled  lateral-longitudinal  dyna¬ 
mics  .  The  other  two  (B  and  C)  reflected  coupled  lateral-longitudinal  dynamics . 


TABLE  1 


"FROZEN"  CONFIGURATIONS 


CONFIGURATION 

Po 

COUPLING 

A 

17.5 

0 

None 

B 

18.8 

3 

Moderate 

C 

18.8 

3 

Strong 
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Figure  2.  Aircraft  and  Di splay  System  Equation  Flow  Diagram 


PILOT  PARAMETER  MEASUREMENTS 


Measurement  of  pilot  dynamic  parameters  was  accomplished  through  use  of 
the  STI  Describing  Function  Analyzer  (DFA)  described  in  detail  in  Refs.  1 
and  2.  Briefly,  the  DFA  is  a  device  for  making  on-line  dynamic  response 
measurements  of  manual  control  systems.  It  generates  a  sum-of-sinusoids 
input  forcing  function  that  is  used  to  excite  the  dynamic  system  under  con¬ 
sideration;  and  computes,  on-line,  the  finite  Fourier  transform  of  a  given 
system  signal  at  each  of  the  forcing  function  frequencies. 

To  obtain  pilot  describing  functions  in  multiaxis  tracking  situations, 
past  laboratory  procedures  have  involved  simultaneous  introduction  of  separate, 
uncorrelated,  forcing  functions  in  each  axis.  This  permits  direct  determina¬ 
tion  of  describing  functions  for  each  axis  as  well  as  for  crosstalk  or  noise 
between  axes.  Unfortunately,  this  does  not  provide  a  realistic  forcing  func¬ 
tion  for  simulation  of  air-to-air  tracking  where  between-axis  target  motion 
is  correlated.  That  is,  there  are  certain  basic  relationships  between  target 
bank,  pitch  and  heading  for  any  useful  aircraft  maneuver.  It  is  not  likely, 
for  example,  that  a  target  will  bank  into  a  turn  and  then  pitch  away  from  the 
turn  (i.e.,  negative  g  turn).  Such  apparent  target  motions  are  rejected  by 
a  skilled  pilot  as  sight  noise  due  to  buffet,  pipper  wander,  etc.  Thus,  to 
provide  a  realistic  input  which  experienced  fighter  pilots  would  track,  it 
was  necessary  to  introduce  the  forcing  function  input  to  one  axis  at  a  time 
and  depend  upon  stationary  run-to-run  performance . 

The  forcing  function  was  employed  to  drive  the  target  aircraft  in  pitch 
(0At)  or  r°H  (<PAt)  •  The  task  was  to  track  (match)  target  motion  with  the 
boresight  symbol.  Coupling  within  the  airframe  dynamics  provided  inter-axis 
disturbance.  Three  control  loop  structures  were  employed  (Fig.  3).  Two  were 
pitch-roll  tracking  tasks  with  the  heading  degree  of  freedom  not  displayed  to 
prevent  inadvertent  yaw  error  from  biasing  the  pilot's  tracking  of  roll  atti¬ 
tude  (i.e.,  temporary  lapses  in  roll  tracking  in  order  to  reduce  heading 
error) .  In  the  third  task  heading  error  was  displayed,  and  the  pilot  was 
specifically  instructed  to  track  heading.  To  test  the  concept  that  pilots 
use  target  bank  angle  as  a  primary  cue,  several  heading  tracking  runs  were 
made  with  the  target  wings  and  tail  removed  from  the  display.  Pilot  commen¬ 
tary  indicated  that  all  tasks  were  essentially  compensatory  tracking  tasks. 
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fORCli^  FUNCTION 


The  amplitude  and  frequency  of  the  five  sinusoids  employed  in  the  forcing 
functions  are  shown  in  Fig.  4.  In  general,  the  amplitude  was  decreased  6  dB 
per  octave  with  increasing  frequency.  However,  the  lowest  frequency  sinusoid 
in  the  pitch  forcing  function  had  to  be  reduced  in  amplitude  because  the 
principal  inter-axis  coupling  was  from  longitudinal  into  lateral  motion  in 
the  frequency  band  of  0.1  to  0.?  rad/sec.  The  coupling  was  so  severe  that 
the  pilots  could  not  maintain  control  of  the  aircraft  for  the  desired  100  sec 
run  time  without  this  decrease  in  forcing  function  amplitude. 

SUBJECTS 

Two  pilot  subjects  were  employed .  Both  are  USAF  experimental  test  pilots . 
Each  participated  in  one  week  of  stall/departure/recovery  handling  quality 
research  runs  before  the  describing  function  measurements  were  made.  In  addi¬ 
tion,  each  pilot  was  allowed  two  training  sessions,  one-half  day  each,  to 
learn  to  track  the  random  target  motion  for  100  sec  without  inducing  a  depar¬ 
ture.  During  all  training  sessions  the  complete  nonlinear  [f(a,p)]  airframe 
model  was  used  and  departures  were  possible.  For  the  final  data  runs  the 
airframe  dynamics  were  frozen  as  indicated  previously  (Table  1 ) . 

ROLL  PILOT  MEASURES  AND  MODEL 

The  open-loop  roll  attitude  dynamics  for  aileron  control  for  each  of  the 
three  configurations  are  shown  in  Fig .  5 •  The  root  locus  and  Bode  for  the 
uncoupled  Configuration  A  case  is  shown  at  the  top  of  Fig.  5  and  that  for  the 
coupled  Configuration  B  is  shown  in  the  middle.  The  bottom  plots  represent 
Configuration  C.  The  relative  magnitude  of  coupling  from  roll  (or  roll  rate) 
control  into  longitudinal  motion  is  reflected  by  the  separation  of  the  complex 
pole-zero  dipole  identified  as  ouSp.  The  closeness  of  this  pair  indicates 
little  coupling  or  excitation  of  longitudinal  motion  by  aileron  for  all  con¬ 
figurations  .  The  only  other  difference  in  the  dynamics  of  these  configura¬ 
tions  lies  in  Configuration  B  which  has  a  low-frequency  complex  pole  (cog^) 
in  place  of  two  real  poles  (i/Tr  and  l/Ts). 
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Figure  4.  Forcing  Function  Spectrum 


Figure  6a  presents  a  direct  comparison  of  the  open-loop  Vc  data  points 
obtained  for  the  three  configurations  and  Fig.  6b  presents  the  YPcp  data  points . 
Also  shown  is  a  reference  20  dB/decade  slope  line.  It  may  be  observed  that 
the  data  exhibit  less  scatter  than  often  is  obtained  for  multiple  runs  of  a 
single  configuration.  In  each  case  the  crossover  is  about  1  .5  rad/sec  and 
the  phase  margin  about  J5-4o  deg.  It  is  apparent  the  pilot  has  adopted  first- 
order  lead  equalization  in  the  vicinity  of  1  rad/sec  so  that  Yp^Yc  approximates 
the  crossover  model  (Ref.  j).  The  only  significant  difference  between  the  con¬ 
figurations  is  in  the  low-frequency  region  where  it  appears  the  coupled  airframe 
dynamics  cause  the  pilot  to  use  somewhat  high  r  gain  and  have  considerably 
greater  phase  lag,  i.e.,  a  low-frequency  lag-lead  equalization.  This  differ¬ 
ence  in  pilot  low-frequency  equalization  is  somewhat  surprising  because  of  the 
similarity  in  the  Bode-root  locus  plots  for  Configurations  A  and  C  in  Fig.  5. 
However,  in  the  next  section  it  will  be  shown  that  longitudinal  control  con¬ 
siderations  significantly  affect  the  pilot's  low-frequency  equalization  in  roll 
tracking. 

The  pilot  model  is  shown  in  Ref.  4  to  be  of  the  form: 


%  4  %  (|)  (¥)  Toms- 
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PITCH  PILOT  MEASURES  AND  MODEL 

The  open-loop  pitch  dynamics  for  the  three  controlled  element  configurations 
are  shown  in  Fig.  7.  Again,  the  uppermost  Bode  and  root  locus  plots  represent 
the  uncoupled  case,  the  middle  plots  the  nominal  Configuration  B  coupled  dyna¬ 
mics,  and  the  lower  plots  the  Configuration  C  case  with  increased  coupling.  It 
may  be  noted  that  the  two  coupled  configurations  have  a  right  half  plane  zero. 
Pilot  closure  of  the  pitch  attitude  loop  drives  the  pole  from  the  origin  into 
this  zero  and  thus  results  in  a  first-order  divergence.  It  is  shown  in  Ref.  4 
that  this  is  related  to  the  nose  slice  divergence.  There  is  also  considerable 
difference  in  low-frequency  amplitude  ratio  for  the  most  highly  coupled 
configuration  (C). 
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In  the  following,  despite  the  coupled  airframe  dynamics,  the  data  obtained 
will  be  analyzed  neglecting  the  contribution  of  the  roll  loop  closure  and 
assuming  the  controlled  element  is  described  by  the  single  open-loop  Yc  shown 
in  Fig.  7*  This  is  an  approximation  only  for  the  two  cases  having  lateral- 
longitudinal  coupling.  But,  more  important,  it  is  shown  in  Ref.  4  that  pilot 
closure  of  the  roll  loop  effectively  decouples  the  lateral-longitudinal  dyna¬ 
mics  to  the  point  that  a  pilot  model  derived  from  the  assumed  uncoupled  case 
provides  a  good  approximation. 


Configuration  A 

The  Yp0Yc  data  were  fitted  for  one  set  of  measurements  for  Pilot  ML  and  are 
presented  in  Fig.  8a  identified  by  the  +  and  □  symbols.  These  points  repre¬ 
sent  an  average  of  two  runs  having  a  maximum  of  i2  dB  and  ±10  deg  phase  from 
the  data  point  plotted.  The  data  spread  for  two  runs  by  Pilot  JS  is  indicated 
by  the  ^  on  Fig.  8a.  These  data  points  were  not  fitted;  they  are  presented 
here  to  show  the  consistency  between  the  two  pilots.  Pilot  JS  obviously  was 
closing  the  loop  with  a  lower  gain  and  therefore  had  a  crossover  somewhat  below 
0.5  rad/sec,  whereas  Pilot  ML  achieved  a  crossover  near  2  rad/sec.  From  the 
20  dB  per  decade  reference  slope  line  shown  on  Fig.  8a  it  is  apparent  that  both 
pilots  closely  approximate  the  crossover  model.  Pilot  JS  would  appear  to  be 
placing  a  first-order  lag  on  top  of  i/T02  and  a  lead  near  “sp  as  might  be 
expected  (see  Fig.  7).  However,  the  transfer  function  fit  to  the  Pilot  ML 
data  indicate  he  is  using  somewhat  more  complex  equalization.  This  may  be 
observed  by  subtracting  the  known  single-loop  Yc  amplitude  and  phase  from  the 


Yp0Yc  data  points 

and  fitting  them  as  shown  in  Fig.  8b.  The 

Yp0  transfer 

function  is  shown  in  Eq.  2: 
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Figure  8.  Single-Loop  Pitch  Attitude  Command  Input  (Configuration  A) 


The  results  provide  an  excellent  curve  fit  and  are  consistent  with  the  pre¬ 
cision  pilot  model  (Ref.  5)  at  low  and  high  frequencies.  A  low-frequency 
lag-lead  is  employed  to  match  the  low-frequency  amplitude  rise  and  phase 
droop  and  a  third-order  neuromuscular  system  was  assumed  at  10  rad/sec. 

The  main  difference  is  the  more  complicated  midband  series  equalization 
which  consists  of  a  second-order  lead  over  a  first-order  lag.  From  the 
amplitude  asymptotes  of  Fig.  8b  it  appears  that  this  complex  equalization 
might  be  approximated  as  a  simple  first-order  lead;  however,  in  order  for 
the  inflections  of  the  fitted  curve  to  closely  match  the  actual  amplitude 
ratio  and  phase  data  points  a  lowly  damped  second-order  lead  is  required. 

It  is  apparent  that  the  pilot  is  precisely  inverting  the  short-period  char¬ 
acteristics.  The  current  precision  model  does  not  contain  a  second-order 
lead  since  it  was  based  on  data  obtained  with  Yc's  having  much  more  ideal 
dynamic  characteristics  than  those  for  the  high-angle-of-attack  case  employed 
here.  That  is,  they  did  not  have  second-order  dynamics  in  the  crossover  region 
and  in  our  case  the  pilot  is  achieving  crossover  right  at  the  short-period  mode 
[  .1 8 ,  1  .9].  Thus,  the  series  equalization  might  be  expected  to  be  more  complex. 

There  is  other  evidence  to  support  the  existence  of  second-order  lead 
equalization.  A  root  plot  of  the  early  Hall  data  (Ref.  6)  is  shown  in  Fig.  9* 
Two  data  points  at  roughly  1  .5  rad/sec  and  low  damping  ratio  are  shown  to  lie 
in  a  region  in  which  double  lead  was  employed.  These  have  ratings  of  7  and  10. 
A  third  data  point  is  at  roughly  2.5  rad/sec  and  also  achieved  a  rating  of  10. 

It  may  be  noted  from  Fig.  7  that  the  short-period  for  all  three  configurations 
investigated  here  would  lie  in  approximately  the  center  of  the  double  lead  area 
shown  in  Fig.  9*  The  Cooper-Harper  ratings  of  8-9  obtained  for  the  three  con¬ 
figurations  in  this  simulation  are  also  consistent  with  the  Hall  data. 

The  Shirley  data  (Ref.  7)  also  resulted  in  pilot  models  with  second-order 
lead.  For  example,  the  transfer  functions  shown  in  Table  2  indicate  the  pilot 
partially  cancels  second-order  modes  of  the  controlled  element. 

The  precise  reason  for  the  Hall  and  Shirley  data  to  result  in  second-order 
leads  is  not  known.  For  the  task  employed  in  our  simulation  the  cancellation 
is  more  complete  than  is  Shirley's.  It  is  suspected  that  the  pilot  learned  to 
completely  suppress  the  short-period  dynamics  in  order  to  prevent  departure, 
since  during  the  task  learning  period  with  the  unfrozen  aerodynamics  relatively 
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Figure  9.  Comparison  of  Theoretical  Non-Equalized  Boundary  with  Hall  Measured  Data 

(From  Ref.  6) 


TABLE  2 


EXAMPLE  PILOT  TRANSFER  FUNCTIONS 
FROM  SHIRLEY  (REF.  11 ) 


*c 

YP 

^e-*1  s 

1  .1 6e  *^S  (s  +  .5)  [s2  +  4s  +5] 

[s2  +  s  +  5] 

(s  +  .13)(s  +  2) 

1  Oe-*1  s 

1 1  e“*2s(  s  +  .4)  [s2  +  3s  +10] 

[s2  +  2s  +  10] 

(s  +  .1  )(s  +  2.32) 

small  increases  in  angle  of  attack  could  result  in  departure .  Since  the 
short-period  mode  is  predominantly  a  and  9  motion,  the  pilot  was  forced  to 
control  a  and  9  quite  tightly  to  suppress  overshoots.  Such  complete  suppres¬ 
sion  of  the  short-period  mode  would  then  require  the  complex  equalization 
shown  in  Fig.  8b .  However,  the  use  of  such  equalization  would  not  be  suspected 

* 

from  the  open-loop  controlled  element  dynamics  alone  (Fig.  7)  .  There  are  also 
no  known  pilot  rating  functionals  for  second-order  lead  equalization.  Thus, 
it  would  be  difficult  indeed  to  predict  both  the  pilot  model  and  pilot  rating 
for  pitch  attitude  control  at  this  Configuration  A  case  in  the  absence  of  the 
departure -prone  context  of  the  unfrozen  aerodynamics . 

Configuration  B 

The  Yp0Yc  amplitude  and  phase  data  points  for  this  case  are  shown  in  Fig.  10. 
Only  the  data  points  for  Pilot  ML  have  been  fitted  (the  lowest-frequency  phase 
point  was  given  zero  weight  in  the  data  fit  for  economy  of  computation) . 

For  this  case  the  crossover  model  seams  better  suited  to  the  lower  gain 
pilot  ( JS) .  Pilot  ML  adopted  a  slope  somewhat  less  than  6  dB  per  octave.  This 
decreased  slope  has  been  observed  previously  (Ref.  3)  on  subcritical  tasks  where 
the  controlled  element  has  a  right  half  plane  pole.  Referring  back  to  Fig.  7> 
it  will  be  noted  that  this  configuration  does  have  a  right  half  plane  zero  at 
0.1  rad/sec.  Closing  the  9  — • *-5e  loop  drives  the  open-loop  pole  from  the  origin 
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into  this  zero  and  therefore  results  in  a  right  half  plane  closed-loop  pole. 
Therefore,  we  might  expect  the  slope  in  the  region  of  crossover  to  be  less 
than  6  dB  per  octave. 

The  closed-loop  right  half  plane  pole  viould  normally  be  expected  to  result 
in  a  pitch  attitude  instability  that  viould  prevent  obtaining  describing  func¬ 
tion  data.  However,  if  the  pitch  attitude  loop  is  closed  tightly,  the  closed- 
loop  pole  is  essentially  driven  into  the  open-loop  zero  and  there  is  very 
little  pitch  modal  response.  The  small  pitch  modal  response  together  with  the 
low  frequency  provides  a  very  long,  slow  pitch  divergence  which  would  not  be 
observable.  But,  the  instability  will  show  up  in  another  mode.  The  situation 
is  analogous  to  tight  attitude  regulation  for  precise  path  control  with  an 
aircraft  on  the  backside  of  the  power  required  curve .  The  path  numerator  has 
a  right  half  plane  zero  which  gives  rise  to  an  unstable  closed-loop  mode.  With 
tight  attitude  regulation,  stable  path  control  is  obtained  initially  and  the 
instability  shows  up  as  a  speed  divergence.  However,  after  prolonged  speed 
decay  the  path  will  also  diverge.  For  our  high  a  case,  the  right  half  plane 
zero  arises  due  to  an  aerodynamic  coupling  stability  derivative,  .  From 
the  Ref.  4  analysis  we  found  that  the  closed-loop  instability  shows  up  in  a 
lateral  mode  (nose  slice)  and  the  pilot  must  close  a  <p  -'•-6a  loop  to  restabi¬ 
lize  it .  The  end  result  is  that  the  pitch  attitude  control  task  is  similar  to 
the  uncoupled  Configuration  A  case  except  the  pilot  is  now  required  to  close 
a  <p  -*-6a  loop  to  decouple  the  lateral-longitudinal  motion  and  hence  is  working 
harder.  Furthermore,  the  longitudinally  induced  instability  lies  in  the  low- 
frequency  region  and  accounts  for  the  previously  noted  lag-lead  equalization 
in  the  roll  pilot  model. 

The  pitch  pilot  describing  function  is  again  obtained  by  subtracting  the 
Yc  from  the  YpQYc  data  of  Fig.  10a  and  curve  fitting  the  resulting  data  points. 
As  indicated  previously  the  effective  Yc  is  adequately  described  (Ref.  k)  by 
the  open-loop  0  8e  transfer  function  of  Fig.  7»  The  resulting  data  points 
and  their  curve  fit  are  presented  in  Fig.  10b.  The  pilot  model  for  the  fit 
is  given  in  Eq.  J: 
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Again,  the  pilot  model  has  the  form  of  the  precision  model  with  a  series 
equalization  consisting  of  a  second-order  lead  over  a  first-order  lag.  From 
Fig.  10b  it  is  apparent  that  the  pilot  is  acting  as  a  pure  gain  in  the  region 
just  below  crossover  and  is  applying  the  second-order  lead  to  cancel  the 
vehicle  short-period  mode.  In  this  case  the  effect  of  the  second-order  lead 
is  more  pronounced  because  of  the  greater  separation  between  it  and  the 
associated  lag  break  point. 


Oonfigur*tion  C 

The  Yp0Yc  data  points  and  curve  fit  for  Pilot  ML  are  shown  in  Fig.  11a. 

Also  shown  are  the  raw  data  points  for  Pilot  JS.  Again,  the  slope  in  the 
region  of  the  crossover  is  less  than  that  which  would  be  obtained  with  the 
crossover  model  and  again  the  pitch  numerator  has  a  right  half  plane  zero. 

In  this  case  it  is  at  0.25  rad/sec  and  provides  a  significant  increase  in  the 
airframe  low-frequency  amplitude.  Also,  upon  closure  of  the  pitch  attitude 
loop,  the  unstable  root  is  driven  further  into  the  right  half  plane  and  thus 
the  mode  divergence  is  more  rapid.  The  unstable  mode  should  be  more  apparent 
to  the  pilots  and  hence  constrain  the  gain  and  equalization  necessary  to  achieve 
satisfactory  performance.  This  is  probably  the  reason  why  the  describing  func¬ 
tion  data  points  for  both  pilots  are  in  closer  agreement  for  this  configuration 
than  for  the  previous  two. 

Again,  subtracting  the  open-loop  6  6e  airframe  amplitude  and  phase  from 
YpgYc  gives  the  data  points  and  curve  shown  in  Fig.  lib.  The  pilot  model  trans¬ 
fer  function  is  presented  in  Eq.  b: 
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Here,  the  low-frequency  lag-lead  apparently  is  not  required  because  of  the 
higher  gain  of  the  Yc.  The  pilot  essentially  adopts  a  pure  gain  out  to  the 
short-period  frequency  and  then  assumes  a  second-order  lead  to  cancel  the 
short-period  resonance  peak. 
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Summary 


Figure  12a  presents  a  direct  comparison  of  the  Yp^Yc  data  points  from  the 
three  configurations  for  Pilot  ML.  These  demonstrate  the  uniformity  the  pilot 
was  achieving  in  the  pitch  task  —  coupled  versus  uncoupled. 

Figure  12b  presents  a  direct  comparison  of  the  Yp0  data  points  after 
removing  the  controlled  element  amplitude  and  phase.  As  with  the  roll  closure 
these  show  remarkable  similarity  in  the  region  of  crossover  and  above  and  could 
readily  be  fit  by  a  single  model.  Again,  the  major  difference  is  in  the  low- 
frequency  band  but  in  this  instance  with  the  greater  coupling  conditions  show¬ 
ing  the  lower  pilot  amplitude  contribution . 

This  is  precisely  the  opposite  of  the  trend  shown  in  Fig.  6  where  the  lateral 
Yp^j  for  the  coupled  case  showed  increased  low-frequency  gain.  It  appears  that 
the  pilot  is  achieving  a  tradeoff  between  the  two  axes  —  possibly  to  effect  a 
decoupling  of  the  motions.  The  major  coupling  is  from  longitudinal  to  lateral 
via  Mq,.  Therefore,  as  coupling  increases  (Mg,  increased),  the  pilot  reduces  his 

r 

longitudinal  gain  and  increases  the  lateral  gain. 

In  all  cases,  whether  coupled  or  uncoupled,  the  pilot  is  closing  the  pitch 
loop  essentially  at  the  short  period  and  is  nearly  canceling  the  short-period 
peak  through  generation  of  a  second-order  lead.  This  unusual  equal.'. option 
has  apparently  been  adopted  through  the  necessity  to  avoid  excessive  angle  of 
attack  and  subsequent  nose  slice  divergence.  A  clue  to  the  possible  tension 
of  the  pilot  in  pitch  control  is  the  quite  small  time  delay  (0.25  <  t  <  0.3  sec) 
obtained  in  this  task  as  compared  to  that  (0.5  <  t  <  O.56  sec)  obtained  in  roll 
(Ref.  A).  This  might  also  signal  that  the  pilot  closes  the  pitch  loop  as  the 
inner  loop  and  roll  as  the  outer  loop . 

The  YpgYc  amplitude  and  phase  did  not  fit  the  crossover  model  for  the  two 
coupled  cases.  These  exhibited  considerably  flatter  amplitude  through  the 
crossover  region  and  are  consistent  with  previous  data  obtained  with  a  con¬ 
trolled  element  having  unstable  modes . 
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HEADING  PILOT  MEASURES  AND  MODEL 


The  heading  pilot  measures  were  obtained  by  inserting  the  forcing  function 
command  as  target  bank  ang^e  but  with  the  target  free  to  displace  in  heading 
[i.e.,  \|fT  =  (g/Uo8)^’  see  Fig.  3c J.  Repeat  runs  were  made  recording  \|ie  and 
cpe  separately  to  facilitate  modeling  the  dynamics  of  each  loop.  The  heading 
and  roll  pilot  models  are  thus  subject  to  the  following  assumptions: 

1  .  The  run-to-run  process  is  stationary. 

2.  The  roll  loop  is  closed  as  an  inner  loop  to  heading. 

3.  Coupling  from  lateral  to  longitudinal  motion  is  suffi¬ 
ciently  slight  that  the  pitch  closure  does  not  alter 
the  lateral  dynamics  appreciably. 

The  Yp^Yc^  data  points  obtained  from  the  \|/e  measures  for  five  nans  with 
Configuration  B  airframe  dynamics  are  plotted  in  Fig.  13.  It  should  be  noted 
from  the  legend  that  these  data  reflect  two  different  piloting  techniques. 

In  two  runs  they  were  allowed  to  use  rudder  if  they  desired.  Rudder  was  not 
considered  beneficial  in  this  task  and  was  used  sparingly,  if  at  all.  However, 
this  appears  partially  responsible  for  the  considerably  greater  scatter  than 
was  obtained  in  the  previous  pitch  and  roll  measurements . 

The  rather  surprising  aspect  of  these  results  is  the  heading  crossover 
above  1  rad/sec.  The  data  are  quite  consistent  in  this  factor.  Past  measures 
of  heading  control  in  landing  or  similar  tasks  have  generally  indicated  cross- 
c"’*rs  considerably  below  1  rad/sec.  With  the  exception  of  three  amplitude 
points  at  3  rad/sec  the  data  also  are  in  good  agreement  with  the  crossover 
model  (slope  20  dB/decade)  . 

The  effective  airframe  Yc^  of  Fig.  13  is  dependent  upon  the  inner  roll 
loop  closure.  As  previously  indicated,  the  feedforward  cpc  path  of  Fig.  3c  was 
purposely  opened  to  determine  the  effect  of  this  path  on  overall  loop  dynamics 
as  measured  by  i|/e .  The  data  points  for  Run  1102-18  of  Fig.  13  reflect  the 
absence  of  this  bank  angle  cue  and  it  is  apparent  that  the  removal  has  little 
effect  on  the  heading  describing  function  data.  It  is  therefore  concluded 
that  the  pilot  pays  little  attention  to  target  bank  angle  during  close-in 
heading  tracking.  This  is  supported  further  by  comparing  the  Yp^Yc  data 
points  obtained  from  the  cpg/cp  measures  for  the  three  loop  (ty,  cp ,  6)  tracking 
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Figure  15.  Measured  Yp  Yc  with  Inner  cp  Loop  Closed 
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task  (Fig.  3c)  with  those  for  the  two  (cp,  6)  loop  task  (Fig.  3a)  .  The 
describing  function  data  for  these  two  cases,  two  runs  each,  ere  plotted 
in  Fig.  l4.  The  three-loop  data  indicate  considerably  less  amplitude  ratio 
at  the  lowest  frequency  and  much  less  phase  lag  at  the  two  lower  frequencies. 
This  is  consistent  with  the  pilot  not  tracking  in  roll  when  this  is  the  inner 
loop.  Therefore,  it  is  not  necessary  to  adopt  the  low-frequency  lag-lead 
equalization  which  was  central  to  the  roll  tracking  task. 

Based  upon  the  comparison  of  data  in  Fig.  14,  a  simplified  inner-loop 
roll  pilot  model  was  selected  as  shown  in  Eq.  5: 


960( .6)  -,4s 
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This  reflects  the  first-order  lead  and  third-order  neuromuscular  lags  identi¬ 
fied  in  Eq.  1  but  the  low-frequency  lag-lead  is  eliminated  and  the  gain  is 
reduced  by  roughly  a  factor  of  four.  The  time  delay  has  also  been  reduced 
slightly  on  the  basis  that  it  would  be  necessary  for  the  pilot  to  reduce  his 
high-frequency  lags  if  the  outer  (ty)  loop  is  to  be  stable  with  a  closure  above 
1  rad/sec.  The  resulting  multiloop  structure  and  dynamics  are  shown  in  Fig.  15. 
The  open-loop,  \|r/Ve,  amplitude  and  phase  plot  for  this  loop  structure  is  shewn 
in  Fig.  16.  Also  shown  in  Fig.  16  are  the  describing  function  data  points  of 
Fig.  13  shifted  in  amplitude  to  correspond  to  an  outer  loop  Kp^  =  0.625.  The 
derived  model  is  considered  to  provide  an  excellent  fit*  to  the  data  points 
measured  during  the  simulation. 

Again,  this  multiloop  model  reflects  a  minimum  equalization,  minimum 
effort,  approach  on  the  part  of  the  pilot.  Apparently,  he  is  using  the  inner 
loop  primarily  to  damp  the  dutch  roll  nuisance  mode.  For  example,  the  open- 
loop  is  0.296  whereas  the  closed  inner-loop  -  O.38.  This  decreases  the 
amplitude  peak  at  dutch  roll  sufficiently  that  the  outer  \| 1  loop  can  be  closed 
tightly  (above  1  rad/sec)  without  the  necessity  for  additional  equalization. 

The  4 1  loop  with  its  high  dc  gain  then  provides  good  flight  path  control. 


*It  is  to  be  reemphasized  that  no  attempt  has  been  made  here  to  model  the 
low-frequency  phase  droop  due  to  the  "a  effect." 
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Figure  14 


Obtained  from  Describing  Function  Analyzer 


Figure  1  5 .  Multiloop  Roll/Heading  Pilot  Model 


SUMMARY  AND  CONCLUSIONS 


Multiloop,  multi-input,  multi-output  pilot  measurements  have  been  made 
for  an  air-to-air  tracking  task  with  aircraft  dynamics  representative  of 
impending  stall/departure .  These  measures  have  allowed  identification  of 
the  effect  of  impending  stall/departure  on  pitch  control,  coupled  versus 
uncoupled  lateral-longitudinal  airframe  dynamics,  and  inner  versus  outer 
loop  applications  on  pilot  dynamic  parameters. 

The  crossover  model  was  found  to  apply  in  all  loop  closures,  including 
multiloop  situations,  except  when  the  controlled  element  exhibits  a  right 
half  plane  pole.  In  the  latter  case  the  crossover  is  achieved  at  an  ampli¬ 
tude  ratio  slope  somewhat  less  than  20  dB/cLecade. 

The  detailed  pilot  models  obtained  for  the  two-loop,  coupled  lateral- 
longitudinal  airframe  tracking  task  reflect  the  precision  pilot  model  form 
except  for  the  adoption  of  a  second-order  series  lead  in  the  pitch  task. 

The  presence  (and  degree)  of  coupling  principally  influences  the  low-frequency 
lag-lead  equalization  adopted  by  the  pilot.  This  is  adjusted  within  and 
between  axes  to  effectively  decouple  the  airframe  motion  with  the  least  pilot 
effort  (equalization). 

Based  only  upon  the  open-loop  pitch  airframe  dynamics  used  here  we  would 
not  expect  the  pilot  to  adopt  second-order  lead  equalization  for  either 
coupled  or  uncoupled  cases.  This  apprently  is  a  result  of  the  requirement 
to  prevent  pitch  (0  or  a)  overshoot  which  would  trigger  a  departure.  Thus, 
the  pilot  adopts  equalization  based  on  crossover,  phase,  and  penalty  criteria. 
While  there  are  some  previous  pilot  parameter  measurement  data  which  also 
reflect  generation  of  second-order  lead,  these  are  insufficient  to  generate 
pilot  rating  functionals  or  to  even  predict  the  adoption  of  such  equalization 
in  the  absence  of  the  departure-prone  context  of  the  unfrozen  aerodynamics. 

Considerably  more  data  must  be  obtained  before  a  paper-pilot-type  model 
can  be  devised  for  the  pre-departure  flight  regime.  Most  past  effort  has  been 
devoted  to  tasks  and  controlled  elements  where  the  airframe  has  relatively 
good  dynamics,  i.e.,  operation  well  within  the  nominal  flight  envelope,  and 
concern  is  related  to  identification  of  the  3*5  boundary.  This  high-angle- 
of-attack  task  has  involved  operation  at  (if  not  beyond)  the  permissible 
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flight  envelope  boundary  with  attendant  airframe  dynamics  which  have  been 
shown  in  the  previous  sections  to  rate  in  the  6  to  9  region  at  best . 

It  was  found  in  the  heading  tracking  task  that  the  pilot  was  not  making 
use  of  target  bank  angle  information  in  the  manner  usually  professed  by 
fighter  pilots,  i.e.,  match  target  bank.  One  possible  explanation  is  that 
this  technique  is  used  mainly  for  gross  maneuvers  and  that  once  in  a  precise 
tracking  position  the  pilot  switches  to  a  "pointing”  mode  —  which  this  simu¬ 
lation  has  shown  can  accomplish  a  heading  crossover  of  greater  than  1  rad/sec 
even  with  relatively  poor  lateral  airframe  dynamics.  If  the  target  were  to 
make  a  sudden  large  bank  angle  change  it  is  likely  the  pilot  would  immediately 
switch  to  a  "match  bank  angle"  mode  to  minimize  either  error  or  reacquisition 
time . 
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ABSTRACT 


Manual  control  of  a  simulated  task  representing  the  regulation  of  angle 
of  attack  In  a  lifting  re-entry  vehicle  has  been  studied  as  the  plant  character¬ 
istics  gradually  change  from  a  pure  Inertia  to  a  dampened  second-order  system. 
The  characteristics  change  rapidly  enough  to  prevent  analysis  by  time  averaging. 
Using  ensemble  averaging,  the  bandwidth  of  the  pseudo  spectra  of  the  tracking 
error  Is  estimated  for  several  transition  speeds,  and  several  Input  disturb¬ 
ance  bandwldths.  The  average  power  In  the  tracking  error  signals  Is  also  esti¬ 
mated.  These  results  are  compared  to  time-stationary  vehicle  analyses  to  show 
that  point -by-point  stationary  analysis  appears  valid  for  transitions  as  rapid 
as  30  seconds.  The  Inability  of  subjects  to  consciously  detect  transitions 
although  they  were  changing  their  control  techniques  Is  discussed. 


1 .  INTRODUCTION 

In  recent  years  there  has  been  an  Increasing  Interest  In  analyzing  the 
behavior  of  human  operators  as  controllers.  The  control  of  time-varying  vehi¬ 
cles  Is  Important  since  most  physical  vehicles  change  with  time,  at  least  to 
some  extent.  Many  manual  control  analyses  can  be  performed  using  time-invariant 
methodology  because  the  vehicles  change  so  slowly  that  polnt-by-polnt  stationary 
analysis  Is  valid.  Manual  control  during  abrupt  or  Instantaneous  changes  has 
been  studied  since  the  mld-1960's,  and  various  models  for  the  human  operator's 
actions  have  been  formulated.  [1][2][3] 

This  paper  concerns  Itself  with  the  study  of  transitions  which  are  neither 
abrupt,  nor  so  slow  that  the  variation  Is  unimportant.  Although  some  work  has 
been  done  In  this  area  [4],  the  difficulties  associated  with  describing  non¬ 
stationary  phenomona  have  limited  most  efforts  to  the  methods  of  time  domain 
analysis  and  optimal  control  theory  [5].  The  Information  presented  here  Is  a 
summary  of  an  Investigation  Into  the  description  of  a  time-varying  manual  con¬ 
trol  problem  using  frequency  domain  parameters  [6]. 

The  Investigation  consisted  of  three  main  phases,  the  first  being  the  de¬ 
sign  and  performance  of  an  experiment  to  generate  and  record  the  necessary  data 
on  a  time-varying  control  task.  The  second  phase  of  the  Investigation  was  the 
development  of  methodologies  which  were  needed  to  analyse  the  time-varying  data. 
The  final  phase  was  then  the  data  reduction  and  Interpretation  of  the  results. 


2.  EXPERIMENTAL  TASK 

Two  subjects  were  asked  to  control  the  longitudinal  dynamics  of  a  sim¬ 
ulated  vehicle  whose  characteristics  varied  from  those  of  a  pure  Inertia  to 
those  of  a  damped  second-order  system.  Given  an  Instrument  similar  to  an 
artificial  horizon,  each  subject  tried  to  maintain  an  angle  of  attack  of  zero, 
while  the  vehicle  was  being  disturbed  in  a  random  fashion.  The  vehicle  char¬ 
acteristics,  as  shown  in  Figures  1  and  2,  varied  as  the  parameter  4> ;  and  <f> 
varied  linearly  from  zero  to  one  In  time  intervals  of  0,30,75  and  120  seconds 
An  analog  computer  with  logic  capability  was  used  for  the  simulation. 


Figure  3  presents  a  block  diagram  of  the  simulation  and  Indicates  the  vari¬ 
ous  elements.  In  order  to  have  a  system  with  a  known  input  and  an  observable 
output,  the  block  diagram  can  be  rearranged  so  that  the  input  is  the  disturbance 
and  the  output  Is  the  error  signal.  It  Is  this  system,  the  pilot-vehicle  com¬ 
bination  In  a  regulator  task  as  Indicated  In  Figure  4,  that  was  analyzed. 

The  Input  disturbance  consisted  of  zero-mean,  Gaussian,  band-limited  white 
noise  with  a  filter  break-frequency  of  0.8,  1.4,  or  2.0  rad/sec.  Thus,  there 
was  a  twelve-entry  condition  matrix  to  which  each  subject  was  exposed.  Each 
entry  was  replicated  10  times  to  provide  a  statistical  sample  for  each  subject 
at  each  condition.  Each  run  consisted  of  a  60  second  Initial  static  phase, 
followed  by  the  time  variation,  and  ending  with  a  final  static  phase  with  the 
length  adjusted  so  that  each  run  lasted  240  seconds. 

The  data  signals  shown  on  r1ot«—  3  (attack  angle,  error,  input  disturbance, 
and  control  stick  deflection),  wes_  -;1  recorded  along  with  a  timing  signal  to 
Identify  the  time  points  at  which  the  variations  began  and  ended.  The  recording 
was  done  In  digital  form  after  passing  the  signals  through  an  A  to  D  converter 
that  sampled  10  times  a  second. 


3.  ANALYSIS  METHODS 


The  time-varying  character  of  the  data  signals  precluded  the  use  of  conventional 
time-averaging  methods.  Thus,  ensemble  averaging  was  used  to  provide  time- 
varying  statistics  for  the  measured  quantities.  The  statistical  quantities 
utilized  were: 
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Although  the  problem  was  time-varying,  the  speeds  of  variation  were  well 
known.  This  allowed  the  use  of  a  quasi-stationary  assumption,  that  is  that 
there  Is  some  relatively  short  period  of  time  during  which  the  characterists  of 
the  data  signals  do  not  vary  appreciably.  The  assumption  then  provides  a  link 
between  a  slowly  time-varying  signal  and  a  series  of  different  spectral  repre¬ 
sentations.  This  series  of  spectral  representations  is  called  the  pseudo-spectral 
representation  of  the  quasi-stationary  signal,  and  the  pseudo  spectra  are  In  gen¬ 
eral  time-varying  quantities. 


It  Is  possible  to  utilize  the  concept  of  quasl-statlonarlty  In  conjunction 
with  ensemble  averaging  In  order  to  decrease  the  statistical  variation  associ¬ 
ated  with  a  statistical  quantity.  This  Is  accomplished  by  taking  ensemble 
arranged  statistics  and  time  averaging  them  within  regions  of  quasl-statlonarlty. 
The  effect  of  this  process  Is  to  Increase  the  effective  number  of  replicates, 
the  amount  of  Increase  depending  upon  the  correlation  between  the  values  being 
averaged. 

Figure  5  shows  the  standard  deviation  of  the  stick  deflection,  attack  angle, 
and  error  signals  versus  time  for  one  subject  and  one  condition.  The  data  shown 
represents  the  10  replicate  ensemble  averages,  averaged  over  1.5  second  Intervals. 
The  square  of  the  standard  deviation,  or  variance.  Is  an  estimate  of  the  power 
In  the  psuedo-spectral  density;  thus.  Figure  5  Is  an  Indication  of  the  manner 
In  which  the  power  In  the  various  signals  changes  with  time. 

Figure  6  Is  a  set  of  plots  of  the  autocovariance  function  of  the  error 
signal  for  one  of  the  subjects  during  one  of  the  time  varying  Intervals.  Direct 
application  of  the  Fourier  Transform  to  these  functions  would  result  In  Imaginary 
spectral  components  and  non-unique  representations.  In  order  to  obtain  an  estim¬ 
ate  of  the  character  of  the  pseudo  spectrum,  the  lowest  value  of  the  time  Inter¬ 
val  from  the  origin  to  the  first  relative  minimum  of  the  autocovariance  function 
was  used  to  estimate  the  bandwidth  of  the  pseudo  spectral  density.  Reference  6 
provides  a  detailed  discussion  of  the  character  and  validity  of  the  bandwidth 
estimate  which  Is  actually  the  bandwidth  of  a  low-pass  rectangular  spectrum 
whose  transform  or  autocorrelation  exhibits  a  first  relative  minimum  at  the 
same  distance  from  the  origin  as  that  of  the  autocovariance  for  the  unknown 
spectrum. 

Applying  this  estimate  to  the  autocovariances  of  the  error  signal  taken  at 
various  points  during  the  transition  gives  and  Indication  of  how  the  signal  band¬ 
width  changes  with  time. 


4.  RESULTS 

The  standard  deviation  of  the  output  of  the  Pilot-Vehicle-Regulator  combin¬ 
ation,  the  error  signal,  was  computed  for  each  subject  at  each  of  the  twelve  con¬ 
ditions.  A  three-way  Analysis  of  Variance  In  conjunction  with  the  Newman-Keuls 
Test  Indicated  that  the  actual  transition  speed  was  not  a  significant  variable; 
whereas  the  Input  filter  frequency  and  the  value  of  $  were  significant  variables 
at  £  <  .001.  Figure  7  shows  the  standard  deviation  during  the  transitions  after 
averaging  out  the  transition  speed.  These  results  Indicate  that  for  the  transitions 
studied  here  the  power  in  the  output  signal  Is  not  a  function  of  the  transition 
speed,  but  Is  dearly  a  function  of  the  Input  bandwidth  and  the  vehicle  config¬ 
uration.  Figure  7  also  indicates  that  the  transitions  In  power  level  of  output 
occur  only  during  a  portion  of  the  vehicle's  transition,  depending  upon  the  In¬ 
put  bandwidth. 

Figure  8,  a  comparison  of  the  transition  with  a  set  of  static  runs  corres¬ 
ponding  to  various  points  In  the  transition,  indicates  that  the  time-varying 
and  the  data  from  static  analyses  are  in  general  agreement. 
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The  estimate  of  the  bandwidth,  called  the  bandwidth  parameter,  of  the  error 
signal  was  computed  for  each  subject  In  each  condition.  Figures  9  through  14 
show  the  effects  of  averaging  out  first  the  filter  frequency  (ay)  variable,  then 

the  transition  speed  variable,  and  finally  the  percent  of  variation  (100  $)  var¬ 
iable.  An  analysis  of  variance  for  subject  B  showed  that  the  shapes  of  all  the 
curves  were  essentially  the  same.  Subject  A  appeared  to  exhibit  an  Inconsist¬ 
ency  relative  to  the  75  second  variation  speed  which  caused  the  analysis  of  var¬ 
iance  to  show  an  Interaction  between  Input  bandwidth  and  transition  speed.  In 
both  subjects,  the  confounding  effect  of  experiencing  the  Instantaneous  switch 
and  the  75  second  variation  during  the  same  session  tended  to  make  the  middle 
speed  (75  second  variation)  data  stand  out  from  the  high  and  low  speed  data  sets. 
Although  the  statistics  show  the  variables  of  transition  speed  and  Input  band¬ 
width  to  be  significant,  It  Is  the  opinion  of  the  author  that  the  significance 
may  be  due  to  confounding  effects  and  also  that  the  variance  due  to  these  fac¬ 
tors  may  be  of  low  practical  Importance.  The  lack  of  Interaction,  and  the 
significance  of  the  percent  of  variation  (100  «j>)  were  certainly  of  prime  Impor¬ 
tance. 

Figure  15  shows  that  the  time-varying  value  of  the  bandwidth  parameter  for 
one  particular  condition  compares  fairly  well  with  those  values  given  by  analy¬ 
sis  of  time-invariant  data  sets  representing  various  points  In  that  same 
transition. 

All  the  results  seem  to  Indicate  that  for  the  tasks  encompassed  by  this 
experiment,  the  pilot's  performance  In  controlling  the  time-varying  system  Is 
essentially  equivalent  to  his  performance  In  controlling  time-invariant  systems 
which  correspond  to  varlou*  points  In  the  transition. 

It  was  noted  In  Informal  conversations  with  the  subjects,  that  they  were 
not  consciously  able  to  detect  the  system  changes  until  well  Into  the  variation, 
l.e. ,  around  the  30-40%  point,  and  yet  they  are  changing  their  characteristics 
almost  Immediately. 
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Figure  4.  Pilot-Vehicle-Regulator 


Figure  5.  Standard  Deviation  of  Recorded  Data  for  Subject  B, 

Input  Filter  Frequency  »  1.4  r/s.  Transition  in  75  seconds 
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Figure  7.  a£  Versus  Percent  Variation  for  3  Input  Filter  Frequencies 
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Figure  10.  Bandwidth  Parameter  Averaged  over  Filter  Frequency,  Subject  B. 
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Figure  11.  Bandwidth  Parameter  Averaged  over  Speed,  Subject  A. 


Figure  12.  Bandwidth  Parameter  Averaged  over  Speed,  Subject  B 
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Figure  13.  Bandwidth  Parameter  Averaged  over  Percent,  Subject  A 
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Figure  14.  Bandwidth  Parameter  Averaged  over  Percent,  Subject  B 
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Figure  15.  Comparison  of  Static  and  Time- Varying  Bandwidth  parameter  for 

Subject  B,  Input  Filter  Frequency  =  1.4  r/s,  Transition  in  75  sec. 
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ABSTRACT 


A  flight  program  using  the  variable  stability  X-22A  aircraft  is  being 
conducted  to  investigate  the  interactive  effect  of  control  augmentation 
complexity  and  display  sophistication  on  pilot  rating  and  performance  for  VTOL 
instrument  landings  employing  n  decelerating  transition  during  a  steep  approach. 
This  paper  provides  a  general  review  of  the  scope  of  the  program,  and  discusses 
in  detail  one  aspect  of  flight  director  design  philosophy  that  has  been  inves¬ 
tigated.  The  paper  demonstrates  with  a  simple  example  that  using  optimal 
control  theory  to  design  flight  director  gains,  assuming  the  pilot  to  be  a 
simple  gain,  leads, to  a  less  stable  closed-loop  system  than  the  "classical" 

STI  K/s  design  for  a  given  level  of  pilot  gain,  and  that  the  closed-loop 
characteristics  are  also  more  sensitive  to  pilot  gain.  An  analog  synthesis 
procedure  using  a  pure  gain  pilot  model  with  a  time  delay  is  then  developed 
which  both  compensates  the  optimal  control  gains  and  defines  a  passive  compen¬ 
sation  network;  this  system  is  shown  to  exhibit  good  closed-loop  dynamics. 
Piloted  ground  simulator  evaluations  verify  the  fact  that  the  uncompensated, 
optimal  design  is  undesirable;  few  noticeable  differences  between  the  compen¬ 
sated  optimal  and  "K/s"  designs  were  found. 


INTRODUCTION 


It  is  clear  that  the  capability  of  V/STOL  aircraft  to  operate  into 
small  areas  can  provide  significant  advantages  for  both  commercial  and 
military  users,  and  in  fact  these  advantages  have  been  demonstrated  under 
visual  flight  conditions.  The  extension  of  this  capability  under  instrument 
conditions,  however,  has  proved  to  be  much  more  difficult  than  the  same 
extension  for  CTOL  aircraft.  This  increased  difficulty  is  a  result  of  the 
fact  that  the  landing  approach  now  involves  not  only  control  of  the  spatial 
position  of  the  aircraft  but  also  precise  control  of  a  non-constant  total 
velocity;  this  task  requires  active  use  of  at  least  one  additional  controller, 


The  experiment  described  here  is  being  performed  under  Contract  No.  N00019- 
73-C-0504  for  the  United  States  Naval  Air  Systems  Command  and  the  National 
Aeronautics  and  Space  Administration,  Langley  Research  Center. 
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and  furthermore  requires  additional  information  to  the  pilot  concerning  the 
increased  dimensions  of  his  task.  The  pilot's  control  problem  is  exacerbated 
by  the  generally  degraded  flying  qualities  encountered  as  the  dependence  on 
powered  lift  increases,  and,  in  VTOL  configurations  different  than  the 
helicopter,  by  an  additional  control  requirement  related  to  the  conversion 
from  forward  flight  to  powered  lift  (e.g.  wing  tilt,  rotor  tilt,  jet  thrust 
vectoring) . 

Accordingly,  a  flight  research  program  using  the  variable  stability 
X-22A  V/STOL  aircraft  has  been  undertaken  to  investigate  the  control,  display, 
and  guidance  requirements  for  VTOL  instrument  landings.  The  primary  purpose 
of  the  experiment  is  to  provide  meaningful  data  related  to  the  interaction 
of  aircraft  control  system  and  pilot  display  characteristics  on  pilot  rating 
and  performance  during  a  steep  decelerating  descending  transition  from  a 
representative  forward  velocity  (  ~  110  kt)  to  a  hover  and  vertical  landing 
under  instrument  conditions.  The  experiment  is  therefore  designed  to  investi¬ 
gate  combinations  of  several  types  of  control  system  characteristics  with 
display  presentations  of  varying  sophistication,  the  most  sophisticated  of 
which  includes  three-axis  continuous  flight  director  information  plus  a  fourth 
discontinuous  "configuration"  director.  As  part  of  the  flight  director  design 
process,  the  "classical"  K/s  approach  pioneered  by  STI  (References  1,  2)  was 
compared  to  "modern"  approaches  using  optimal  control  theory  (Reference  3) , 
with  some  interesting  results. 

This  paper  therefore  has  the  following  two  objectives: 

•  To  provide  a  general  description  of  the  scope  of  this  flight 
program 

•  To  discuss  in  detail,  using  a  simple  example,  one  aspect  of 
flight  director  design. 

The  organization  of  the  paper  is  as  follows.  The  first  two  sections  review 
briefly  the  X-22A  research  facility  and  the  current  research  experiment.  The 
following  sections  discuss  in  detail  a  hypothesized  design  procedure  for  flight 
director  gains,  compare  the  resulting  design  with  "classical"  and  "modern" 
approaches  for  a  simple  example,  and  review  preliminary  piloted  simulator 
results  of  testing  the  hypothesized  design.  The  final  section  presents  some 
concluding  remarks. 


X-22A  RESEARCH  FACILITY 

The  X-22A  research  facility  consists  of:  (1)  the  X-22A  aircraft 
itself,  with  associated  response-feedback  variable  stability  system,  onboard 
analog  computer,  and  onboard  programmable  analog  symbol  generator  for  an 
electronic  display;  (2)  a  mobile  ground  station,  which  receives  all  flight 
data  via  telemetry,  acts  as  a  processor  for  digital  data  analyses,  and  provides 
the  computational  capability  for  the  ground  simulator;  and  (3)  the  X-22A 
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ground  simulator,  which  consists  of  an  X-22A  cockpit  and  variable  stability 
system  identical  to  that  of  the  aircraft.  This  total  facility  is  described 
in  detail  in  References  4,  5,  and  6,  and  is  therefore  only  summarized  here. 

As  is  shown  in  Figure  1,  the  X-22A  aircraft  has  four  ducted  propellers 
and  four  engines.  The  engines  are  connected  to  a  common  system  of  rotating 
shafts  which  distribute  propulsive  power  to  the  four  propellers.  Changes  in 
the  direction  of  the  thrust  vector  are  accomplished  by  rotating  the  ducts, 
which  are  interconnected  so  that  they  all  rotate  through  the  same  angle. 

Thrust  magnitude  is  determined  by  a  collective  pitch  lever,  similar  to  a 
helicopter;  a  recent  expansion  of  the  capability  is  the  alternative  of  a  fore- 
and-aft  thrust  magnitude  controller.  Normal-looking  pitch,  roll,  and  yaw 
controls  in  the  cockpit  provide  the  desired  control  moments  by  differentially 
positioning  the  appropriate  control  elements  (propeller  pitch  or  elevon 
deflection)  in  each  duct. 


There  are  four  variable  stability  system  (VSS)  controllers  -  thrust, 
pitch,  roll  and  yaw  •  and  three  artificial  feel  servos  for  the  evaluation 
pilot  cockpit  controls,  each  employing  electrohydraulic  servos.  When 
rigged  for  VSS  flight,  the  left  hand  flight  controls  are  mechanically  discon¬ 
nected  from  the  right  hand  flight  controls  and  connected  to  the  set  of  VSS 
pitch,  roll  and  yaw  feel  servos.  The  VSS  thrust  servo  operates  the  boost 
servo  for  the  collective  pitch  system.  VSS  pitch,  roll  and  yaw  servos  operate 
the  righl  hand  flight  controls,  moving  the  same  linkages  which  are  moved 
manuall1'  by  the  right  hand  pilot  in  normal  non-VSS  flight.  (In  fact,  these 
same  actuators  serve  a  dual  role  by  providing  artificial  feel  for  the  primary 
flight  control  system  when  the  VSS  is  not  engaged.)  Phasing  of  these  control 
motions  to  the  blades  and  elevons  is  accomplished  by  the  mechanical  mixer  as 
for  normal  flight. 

During  VSS  operation,  the  evaluation  pilot  occupies  the  left  hand 
seat  in  the  cockpit.  The  system  operator,  who  also  serves  as  the  safety 
pilot,  occupies  the  right  hand  seat  The  evaluation  pilot's  inputs,  in  the 
form  of  electrical  signals,  rperate  >khe  appropriate  right  hand  flight  controls 
through  the  electrohydraulic  servos.  In  addition  to  the  evaluation  pilot's 
inputs,  signals  proportional  to  aircraft  motion  and  relative  wind  variables 
(for  example,  angle  of  attack  or  pitch  rate)  are  fed  back  to  move  the  right 
hand  controls  in  the  required  manner  and  thus  modify  the  aircraft's  response 
characteristics  as  desired.  The  response-feedback  and  input  gain  controls  are 
located  beside  the  safety  pilot  and  are  used  to  set  up  the  simulation  config¬ 
uration  in  flight.  Note  that  the  evaluation  pilot  cannot  feel  the  basic  X-22A 
control  motions  caused  by  the  variable  stability  system. 

Recent  additions  to  the  aircraft  systems  include  an  on  board  analog 
computer  and  a  programmable  symbol  generator  for  an  electronic  display.  The 
analog  computer  provides  the  capability  to  compute  flight  director  gains, 
generate  additional  control  variations  (e.g.,  command  pre-filtering)  and  per¬ 
form  guidance  data  transformations  and  smoothing.  The  symbol  generator  provides 
up  to  32  different  symbols  for  display  on  a  cathode  ray  tube,  and  the  capability 
to  vary  the  symbols  presented  during  a  flight  is  provided  by  switches  on  a 
separate  console. 

Figure  2  summarizes  schematically  the  functions  of  the  mobile  ground 
station  developed  for  the  X-22A.  The  primary  purposes  of  the  equipment  include 
flight  safety  monitoring,  real-time  data  monitoring  and  experiment  control, 
and  data  processing  for  flight  operations.  The  mini-computer  provides  on-line 
monitoring  of  all  the  down-link  telemetry  data  and  alerts  the  ground  crew 
whenever  any  parameter  exceeds  preset  limits.  In  addition,  the  mini-computer 
serves  as  the  computer  for  the  ground  simulator.  Paramount  among  the  digital 
data  processing  techniques  available  to  be  applied  to  the  recorded  flight 
data  is  a  digital  identification  technique  developed  for  the  X-22A  and  success¬ 
fully  applied  to  over  300  data  records  to  date  (References  7  and  8) ;  an  example 
is  shown  in  Figure  3. 
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X  ??A  AIRCRAFT 


-  ■  FLIGHT  OPERATION 

- - OATA  PROCESSING 


Figure  2  SCHEMATIC  DIAGRAM  OF  DIGITAL  DATA  ACQUISITION  SYSTEM 


The  fixed-base  X-22A  ground  simulator  (Figure  4)  is  designed  to  sup¬ 
plement  the  X-22A  aircraft  operation  in  the  following  manner: 

•  Perform  preliminary  tests  of  experimental  programs  prior 
to  flight  tests  in  the  actual  aircraft. 

•  Develop  new  experimental  hardware  and  systems,  such  as 
control  systems  and  displays,  prior  to  installation  in  the 
actual  aircraft. 

•  Ground  test  new  equipment  and  check  experimental  setups 
in  the  aircraft  prior  to  actual  flight  test. 

•  Provide  pilot  training  as  required. 

The  first  of  these  capabilities  was  used  to  perform  preliminary  evaluations 
of  the  flight  director  designs  to  be  discussed  shortly. 
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Figure  3  IDENTIFICATION  OF  CONFIGURATION  4 


Figure  4  X22A  GROUND  SIMULATOR 


CURRENT  X-22A  RESEARCH  PROGRAM 

The  first  two  X-22A  programs  investigated  STOL  flying  qualities  and 
demonstrated  the  usefulness  of  the  X-22A  aircraft  as  a  viable  experimental  tool 
(References  9,  10,  11,  and  12).  In  addition,  as  is  discussed  in  Reference  4, 
the  second  program  also  performed  preliminary  flight  work  relevant  to  the  VTOL 
decelerating  landing  problem.  In  a  general  sense,  the  conclusions  of  these 
two  programs  most  relevant  to  the  current  program  might  be  summarized  as 
follows : 

•  For  a  simple  but  steep  approach  trajectory  (constant  speed 
and  descent  angle),  if  longitudinal  and  lateral-directional 
stability  and  control  characteristics  are  such  as  to  provide 
satisfactory  flying  qualities  (PR  <  3.5),  then  instrument 
approaches  could  be  performed  using  only  standard  aircraft 
electromechanical  instrument  displays  and  raw  ILS  information 
with  an  ease  and  precision  similar  to  steep  visual  approaches. 

•  For  a  more  complex  approach  (constant  steep  descent  angle 
but  decelerating  along  the  glide  path),  instrument  approaches 
could  not  be  successfully  performed  using  the  same  instrumenta¬ 
tion  and  guidance  display. 
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The  current  flight  program  is  therefore  a  logical  outgrowth  of  the 
first  two.  As  was  discussed  at  the  beginning  of  this  paper,  the  purpose  of 
the  experiment  is  to  attempt  to  define  satisfactory  control-display  system 
combinations  to  perform  decelerating  descending  approaches.  The  general  con¬ 
cept  guiding  the  experiment  design  was  based  on  attempting  to  quantify  the 
control-display  interplay  on  pilot  rating  and  performance;  this  quantification 
was  given  the  highest  priority  for  future  research  by  the  AGARD  Advisory  Report 
on  V/STOL  display  requirements  (Reference  13),  and  is  shown  schematically  in 
Figure  5.  The  configuration  matrix  was  developed  on  the  basis  of  work  done 
by  NASA  Langley  (References  14,  15)  and  extensive  ground  simulation  on  the 
X-22A  ground  simulator;  the  base  matrix  is  shown  in  Figure  6.  Brief  descrip¬ 
tions  of  the  elements  of  each  axis  are  given  below. 
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- INCREASING  CONTROL  SOPHISTICATION 

STABILITY  AUGMENTATION 


AUTOMATIC  ALTITUDE  AND  SPEED  CONTROL 
COUPLED  GUIDANCE  AND  MULTIPLEX 


Figure  5  TRADE  OFF  BETWEEN  DISPLAY  AND  CONTROL  SOPHISTICATION 
(FROM  REFERENCE  13) 


INCREASING  COMPLEXITY 


Figure  6  BASE  CONFIGURATION  MATRIX  (25  CONFIGURATIONS) 


(1)  Control  Systems 

•  Rate  Augmentation.  This  control  system  represents  the 
minimum  controi  and  stability  augmentation  system  com¬ 
plexity  considered  for  this  program.  In  particular,  the 
system  is  mechanized  as  rate  SAS  only  instead  of  the  more 
complex  rate-command,  attitude-hold  type  of  system.  Pitch, 
roll,  and  yaw  rate  stabilization  approximately  equal  to 
the  basic  X-22A  SAS  is  used  as  a  level  representative  of 
V/STOL  aircraft. 

t  Attitude  Augmentation  and  Control  Shaping.  This  system 
represents  the  most  complex  angular  augmentation  investi¬ 
gated,  and  is  essentially  equivalent  in  concept  to  that 
used  in  Reference  15.  The  pitch  and  roll  axes  are  attitude 
stabilized  through  high  feedbacks  and  the  control  inputs 
to  these  axes  are  shaped  through  a  second  order  prefilter 
or  model  to  provide  satisfactory  responses  to  the  stick 
commands. 

•  Direct  Velocity  Control.  The  purpose  of  this  control 
system  is  to  give  the  pilot  decoupled  control  of  the  two 
longitudinal  velocity  components  (with  respect  to  the 
ground)  by  using  control  crossfeeds  and  response  feedback 
including  duct  angle. 
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•  Automatic  Duct  Angle  Control.  This  system  represents  a 
minimal  automation  complexity  by  removing  the  necessity 
for  the  pilot  to  change  aircraft  configuration  (i.e.,  duct 
angle) .  The  implementation  of  this  system  uses  the  same 
logic  as  the  ITVIC  light  to  be  discussed  shortly,  with  the 
signal  now  driving  the  ducts  instead  of  the  light. 

•  Automatic  Duct  Angle  and  Glide  Slope  Tracking  Control . 

This  system  represents  the  maximum  automation  complexity 
which  maintains  the  pilot-in-the-loop  as  essentially  an 
attitude  regulator  only.  The  mechanization  of  this  system 
uses  the  thrust  magnitude  flight  director  logic  to  feed 
signals  directly  to  the  thrust  controller  (i.e.,  collective 
stick)  and  the  automatic  duct  angle  control  discussed  above. 

(2)  Displays 

•  Electronic  Display.  The  electronic  display  integrates 
vertical  and  horizontal  information  plus  command  infor¬ 
mation  in  one  unit  to  minimize  scanning  problems.  Much 
of  the  symbology,  as  well  as  the  analog  symbol  generator, 
is  based  on  work  done  by  Dukes  (References  16,  17). 

Three  formats  are  being  investigated  in  this  experiment: 

(a)  ED-1:  position  and  commanded  position  information 

(b)  ED-2:  position,  commanded  position,  ground  velocity, 

and  commanded  ground  velocity  information 

(c)  ED-3:  position,  commanded  position,  ground  velocity, 

and  pitch,  roll,  thrust  magnitude  control 
directors . 


These  formats  and  the  symbology  are  shown  in  Figure  7  in 
an  earth-referenced  axis  system  for  ED-3. 


RANGE  RATE 
ERROR 
(TOO  SLOW) 


Figure  7  ELECTRONIC  DISPLAY  SYMBOLOGY  (EARTH-REFERENCED) 
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•  ADI  and  Integrated  Cross  Pointers/Tab.  An  electromechanical 
attitude  indicator  with  integrated  pointers  is  used  as  an 
auxiliary  vertical  disp'ay.  The  pointers  and  tab  either 
present  flight  director  information  (with  ED-1)  or  are 

not  active. 

•  Independent  Thrust  Vector  Inclination  Command  (ITVIC)  Light. 
V/STOL  aircraft  that  require  configuration  changes  to 
convert  from  forward  flight  to  hover  may  need  to  be  provided 
with  command  information  to  effect  these  changes.  For  the 
X-22A,  the  duct  rotation  control  is  an  "ON-OFF"  rotation 
rate  controller,  and  hence  the  rotation  command  should  be 

an  "ON-OFF"  signal.  In  the  ground  simulation  investigation 
it  was  found  that  using  a  light,  which  came  on  when  the 
commanded  duct  angle  exceeded  the  duct  angle  by  a  specified 
amount,  provided  significant  improvements  in  pilot  opinion 
of  control-display  combinations  which  required  duct  angle 
changes  independently  (i.e.,  rate  augmentation,  attitude 
augmentation).  Therefore,  most  of  the  display  combinations 
for  the  two  least  complex  control  systems  will  be  evaluated 
with  and  without  the  ITVIC  director  to  ascertain  possible 
benefits  in  performance. 

At  the  time  of  the  writing  of  this  paper,  the  flight  program  is  not 
sufficiently  complete  to  ascertain  whether  or  not  the  results  expected  from 
this  experiment  design  will  materialize.  By  virtue  of  the  ground  simulation 
capability,  however,  it  has  been  possible  to  investigate  the  configuration 
matrix  in  a  general  sense;  in  addition,  the  design  process  itself  has  resulted 
in  hypotheses  that  have  led  to  some  interesting  discoveries.  The  remainder 
of  this  paper  discusses  the  generation,  theoretical  verifica;  ion,  and  experi¬ 
mental  investigation  of  one  of  these  hypotheses  in  the  design  of  the  flight 
director  signals. 


DEVELOPMENT  OF  A  "COMPENSATED  OPTIMAL" 

FLIGHT  DIRECTOR  DESIGN  PHILOSOPHY 

The  flight  director  signals  used  in  the  initial  X-22A  ground  simulator 
study,  which  was  preliminary  to  the  current  experiment  (Reference  6),  were 
based  on  the  well-known  manual  control  theory  result  of  attempting  to  have  the 
open  loop  controlled  element  frequency  response  be  K/s  in  the  region  of  pilot 
crossover  (References  1,  2).  It  is  not  clear,  however,  that  this  approach 
leads  to  the  best  closed-loop  automatic  system  if  the  pilot  is  replaced  by  a 
zero-delay  black  box  of  gains.  Since  optimal  control  theory  provides  a  useful 
tool  for  designing  zero-delay  automatic  systems  in  multiloop  multichannel 
situations,  a  preferable  flight  director  design  might  be  based  on  compensating 
such  an  optimal  design  for  the  pilot  to  act  in  it.  Reference  3  is  an  example 
of  a  study  with  a  similar  aim,  but  in  that  case  the  pilot  model  used  neglected 
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the  inherent  effective  time  delay  of  the  pilot,  which  is  an  assumption  of 
dubious  validity.  The  design  philosophy  developed  during  the  program  described 
in  this  paper  is  therefore  an  attempt  to  ensure  that: 


1.  the  pilot  does  not  need  to  do  any  compensation;  i.e.,  he  acts 
as  a  proportional  control  with  an  inherent  delay 

6  rs)  *  *  c "  rj 

P  P 

with  T  *  C.3  sec  (0.2  to  0.4  is  a  usual  range  of  values) 


2.  the  closed-loop  performance  (some  function  of  the  trajectory 
error)  is  comparable  with  that  of  using  a  zero-delay  automatic 
landing  system  designed  using  optimal  control  theory,  for  a 
reasonable  loop  gain,  as  well  as  with  that  of  a  K/s  design. 


With  these  two  criteria,  the  man-vehicle  closed-loop  system,  will,  theoretically, 
have  good  mission  performance  and  the  pilot  will  be  comfortable  flying  the 
mission. 


The  design  problem  is  solved  in  two  steps.  First,  uncompensated 
optimal  control  gains  are  found  for  an  automatic  system.  These  gains  are 
then  compensated  for  the  pilot's  time  delay  in  an  approximate,  analog  fashion 
for  implementation  in  a  flight  director.  The  symbology  is  shown  in  Figure  8, 
and  the  problem  solution  outlined  below. 


Figure  8  FLIGHT  DIRECTOR  DESIGN  PROBLEM 
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Since  s'^and  &F*  represent  constant  gain  adjustments,  the  remaining  problem 
is  an  approximation  to  the  convolution  integral  for  analog  mechanization. 

Making  a  linear  assumption  for  u  (t)  between  t-T  and  £  ,  we  have  : 
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Hence,  the  flight  director  signal  becomes: 


*c(t)  =  (I  *  XX3j 


*0  c.  (*)  ~  x'c.  Frx(V  -XX  u(t-zrj 
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or  transforming  to  the  "s"  domain: 
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Invertability  of  F  is  not  requited,  since 
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The  resulting  flight  director  is  shown  in  Figure  9.  The  following 
important  points  should  be  noted: 

(1)  The  design  is  directly  applicable  to  a  multivariable 
multicontroller  situation. 

(2)  The  initial  term  of  the  equation  is  a  delay  compensator 
which  is  always  physically  realizable  (poles  and  zeros  in 
the  left-hand  plane) . 

(3)  The  design  has  the  advantages  associated  with  quadratic 
synthesis  of  providing  a  complete  procedure  which  ensures 
a  stable  closed-loop  system  with  good  performance 
characteristics. 

FLIGHT  DIRECTOR  PILOT 


I _ I 


Figure  9  COMPENSATED  OPTIMAL  CONTROL  FLIGHT  DIRECTOR 


For  implementation  simplicity,  a  first-order  Pade  approximation 
might  be  used  for  ;  the  initial  term  (delay  compensator)  then  becomes: 
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For  example,  a  single  controller  problem  reduces  to  the  scalar  expression: 
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As  can  be  seen,  this  approximation  for  a  single  controller  leads  to  a  delay 
compensator  which  is  a  simple  lead-lag  circuit. 


APPLICATION  OF  HYPOTHESIS  TO  EXAMPLE 


To  test  the  hypothesized  design  against  both  a  typical  K/s  design 
and  a  zero-delay  optimal  control  design  as  in  Reference  3,  the  plunge  mode 
of  the  X-22A  in  hover  was  considered.  For  this  example,  considering  a  constant 
commanded  altitude  (  =  10  ft) : 


-  (I  /J.  •  4 


<w 


Designing  the  automatic  system  to  have  closed-loop  characteristics  of  »  .7, 
•  2.5  rad/sec  yields  the  uncompensated  gains: 


*  «  (-3.16,  -1.68),  •  -3.16 

For  the  uncompensated  case,  then,  the  displayed  quantity  is: 

«  (S)ac  *  {  -3  ^(3c  '  >  (s))  *  A  Af's  }  rSj} 

where  A?  is  a  variable  "sensitivity"  scalar. 

H 

Assuming  a  time  delay  of  0.3  seconds,  the  compensator  gains  are: 


(-!)■  v(:: 
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Hence,  the  compensated  displayed  signal  is  (in  the  frequency  domain): 

-  &J)  +  3  ts) 

For  comparison  with  the  above,  a  K/s  design  for  this  example  valid  over  all 
frequencies  would  be: 

“•  w  ^  -  <J  (■*  -  * *)(UCS>  v 

Root  loci  sketches  for  each  of  these  cases  with  a  pilot  model  -  K 

are  shown  in  Figure  10. 
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b)  OPTIMAL  CONTROL  DESIGN  WITH  DELAY  COMPENSATION 


Figure  10  ROOT  LOCI  FOR  FLIGHT  DIRECTOR  DESIGN  EXAMPLE 


Time  histories  ere  shown  in  Figure  11  for  these  designs  and  various  values  of 
pilot-display  (a^,^)  gain.  On  the  basis  of  these  time  histories,  the 
following  results  would  be  expected  in  a  piloted  simulation: 

•  The  uncompensated  (zero-delay)  optimal  design  would  be 
unacceptable  due  to  closed-loop  lightly  damped  oscillations 
for  a  relatively  low  value  of  pilot  gain 

•  The  compensated  optimal  design  would  yield  closed-loop 
performance  that  is  similar  to  that  of  the  zero-delay  optimal 
design  for  the  same  loop  gain. 

•  The  compensated  optimal  and  K/s  designs  should  have  similar 
sensitivities  to  changes  in  pilot  gain,  and  would  provide  similar 
closed- loop  performance. 

The  following  section  reviews  the  results  that  actually  were  obtained  in  a 
piloted  simulation. 


EXPERIMENTAL  INVESTIGATION  OF  DISPLAY  PHILOSOPHY 


To  obtain  a  preliminary  estimate  of  the  efficacy  of  the  new  flight 
director  design  philosophy,  the  compensated  and  the  uncompensated  optimal 
design  was  implemented  for  the  *c$  command  on  the  ED-3  display  discussed 
earlier  and  evaluated  on  the  X-22A  ground  simulator  against  the  conventional 
K/s  design.  For  completeness,  an  additional  design  which  added  a  delay 
compensator  (based  on  the  same  theory)  to  the  K/s  design  was  also  investigated. 
Since  the  implementations  were  only  on  the  6 cs  command  (collective  stick), 
which  is  used  for  altitude  control,  the  primary  differences  among  the  designs 
appear  in  tracking  errors  both  for  the  command  and  for  the  command , 
workload  (collective  and  longitudinal  stick  motions),  and  pilot  commentary 
and  rating.  Three  pilots  performed  qualitative  relative  evaluations  of  the 
four  designs;  in  addition,  two  engineers  familiar  with  the  designs  but  not 
the  specific  one  being  evaluated  also  performed  "quick  look"  studies.  The 
task  included  glide  slope  acquisition  and  tracking  during  deceleration  to  a 
precision  hover;  tie  pilots  were  instructed  to  attempt  to  make  step  altitude 
changes  after  the  precision  hover  had  been  achieved  to  aid  in  their  evaluation 
of  the  director.  The  qualitative  results  are  summarized  below: 

(1)  Performance:  command  tracking  was  best  (in  the  sense  of 

mean  square  error)  with  the  compensated  K/s  design,  followed  by 
the  uncompensated  K/s  design  and  then  the  compensated  optimal 
design;  no  large  differences  among  those  three  were  found, 
however.  The  uncompensated  optimal  design  gave  significantly 
worse  <?££  command  tracking  performance.  The  tracking  performance 
of  the  (longitudinal  stick)  command  was  also  checked  as  an 
indication  of  the  amount  of  attention  the  pilots  needed  to  devote 
to  tracking  the  <fC3  command;  this  performance  measure  was  best 
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with  the  new  compensated  optimal  design,  followed  by  the  compen¬ 
sated  K/s  design  and  then  the  uncompensated  K/s  design,  with 
no  large  differences  among  these  three.  Again,  the  performance 
was  the  worst  for  the  uncompensated  optimal  design. 

(2)  Control  Activities:  Collective  stick  (  )  motion  was  least 

with  the  new  compensated  optimal  design,  followed  by  the  com¬ 
pensated  K/s  design.  Longitudinal  stick  (  Sms)  motion  was 
least  for  the  compensated  K/s  design,  followed  by  the  compen¬ 
sated  optimal  design.  For  both  sticks,  the  most  motion  (high¬ 
est  workload)  occurred  with  the  uncompensated  optimal  design. 

(3)  Pilot  Opinion:  The  pilots  were  unanimous  in  disliking  the 
uncompensated  optimal  director  the  most.  In  all  cases,  they 
found  it  "sloppy"  and  overcontrolled  it,  with  tendencies  toward 
a  PIO.  In  general,  the  pilots  preferred  both  the  compensated 
and  the  uncompensated  K/s  designs  to  the  compensated  optimal 
design,  although  no  significant  differences  were  noted. 

These  results  ver’  the  hypothesis  that  the  uncompensated  optimal 
control  flight  director  design  results  in  poor  system  performance  and  pilot 
rating.  The  pilots  generally  preferred  the  K/s  design  to  the  compensated 
optimal  design,  although  measurable  differences  were  not  significant.  It  is 
interesting  to  note  that  the  compensated  optimal  design  might  have  been 
degraded  somewhat  relative  to  the  K/s  system  by  the  following  factors: 


•  System  noise  is  considerably  amplified  in  the  compensated 
optimal  control  design,  both  because  of  the  higher  feedback 
gains  and  also  because  of  the  lead  term  in  the  compensator. 
This  noise  on  the  director  needle  was  disconcerting  to  all  of 
the  pilots. 

•  Pilots  tended  to  describe  the  compensated  optimal  system  as 
exhibiting  a  "predictable  fina1  response  but  sluggish  initial 
response"  to  control  inputs.  This  situation  is  illustrated  in 
Figure  12.  In  this  figure,  the  dominant  branch  root  loci  of 
the  K/s  design  and  the  "compensated  optimal"  design  are  com¬ 
pared.  It  is  evident  that,  with  decreasing  pilot  gain,  the 
"compensated  optimal"  system  undergoes  a  reducticn  in  band¬ 
width  accompanied  by  a  slight  undamping  of  the  lower  frequency 
closed-loop  rcot.  With  increasing  pilot  gain,  the  system 
bandwidth  increases,  but  the  damping  of  the  higher  frequency 
closed-loop  root  is  reduced.  The  system  becomes  unstable  at 
approximately  the  same  value  of  pilot  gain  at  which  the  K/s 
design  system  does.  If  the  optimal  control  design  had  been 
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Figure  12  DOMINANT  BRANCH  ROOT  LOCI  OF  K/S  DESIGN 
AND  "COMPENSATED  OPTIMAL"  DESIGN 


3 

for  a  closed-loop  system  of  3.5  rad/sec  rather  than  2.5  rad/ 
sec,  the  system  bandwidth  would  have  approached  that  of  the 
K/s  system  at  the  design  point.  This  design  change  should 
result  in  a  more  acceptable  response  to  control  input*.  ; 


The  example  design  considered  a  step  command  in  altitude.  It 
is  possible  that  applying  this  design  to  the  glide  slope  acquisi¬ 
tion  and  tracking  task  was  not  proper,  and  instead  it  should  have 
been  redesigned  to  follow  a  step  plus  ramp. 


CONCLUDING  REMARKS 

The  interaction  of  aircraft  control  system  complexity,  guidance  re¬ 
quirements,  display  sophistication,  and  aircraft  flying  qualities  presents  a 
multidimensional  research  problem  whose  solution  is  not  yet  well  understood. 

The  current  X-22A  experiment  will  make  an  initial  contribution  to  understand¬ 
ing  this  problem  for  V/STOL  instrument  landings,  and  the  research  facility 
provides  an  unmatched  capability  for  performing  research  in  this  area;  possible 
examples  include  guidance,  display,  and  control  requirements  to  permit  zero-zero 
shipboard  VTOL  landings,  or  similar  requirements  for  VTOL,  STOL  or  conventional 
aircraft  using  projected  microwave  landing  systems  (MLS).  The  X-22A's  combina¬ 
tions  of  variable  stability/control  dynamics  and  variable  display  capabilities, 
coupled  with  the  increased  efficiency  of  flight  time  usage  afforded  by  the 
ground  simulator  capability  and  the  digital  data  processing  system,  results  in 
a  versatile  and  extremely  useful  research  tool  for  these  investigations. 

This  paper  has  reviewed  the  current  experiment  and  these  capabilities 
in  a  general  fashion,  and  has  also  discussed  in  more  detail  one  aspect  of 
flight  director  design  philosophy  that  has  been  investigated  in  the  preliminary 
phase  of  the  program.  A  design  philosophy  was  formulated  which  uses  quadratic 
synthesis  to  design  an  automatic  control  system;  the  characteristics  of  the 
automatic  system  are  then  rationally  compensated  to  allow  for  a  human  controller. 
Based  on  both  analytic  and  experimental  investigation  of  this  hypothesized 
design,  the  following  general  remarks  are  in  order: 

•  A  flight  director  design  which  uses  optimal  control  theory 

without  explicitly  accounting  for  the  pilot  delay  term  resulted 
in  unsatisfactory  pilot-vehicle  closed-loop  dynamic  character¬ 
istics.  The  pilot  delay  term  must  be  included  to  provide  a 
viaole  design. 


•  Using  a  pilot  model  consisting  of  a  gain  and  a  pure  time  j 

delay,  a  synthesis  procedure  was  developed  to:  a)  compensate 
the  optimal  gains,  and  b)  provide  a  physically  realizable 
delay  compensator  circuit.  This  procedure  results  in  a  closed- 
loop  system  including  the  pilot  whose  performance  is  the  same  >3 

as  the  optimal  automatic  (no  time  delay)  system  for  similar  loop  gains. 

d 
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•  Both  analytic  and  ground  simulator  investigations  demonstrated 
that  the  compensated  optimal  design  was  similar  to  the 
classic  "K/s"  system  in  performance  and  pilot  rating,  although 
the  K/s  design  was  generally  preferred  by  the  pilots. 

•  The  design  approach  developed  in  this  paper  has  the  advantage 
of  providing  a  uniform  approach  to  both  automatic  control  and 
manual  display  design  for  multiloop,  multichannel  situations. 
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ABSTRACT 


The  basic  mechanisms  for  vibration  interference  with  manual  control 
tasks  have  been  explored  in  a  series  of  studies  sponsored  by  the  USAF 
Aeromedical  Research  Laboratories,  and  the  general  approach  and  early 
findings  have  been  previously  published  at  this  conference.  This  paper 
presents  a  summary  of  some  new  results  on  the  effects  of  sinusoidal  and 
quasi-random  vertical  vibration. 

Performance  and  cross-power  spectra  measurements  are  presented  which  show 
vibration-induced  effects  in  the  visual -motor  dynamics  and  remnant.  Describ¬ 
ing  function  measurements  of  head  motion  and  subjective  comments  on  visual 
blur  show  large  effects  in  the  region  of  7  Hz  which  correlate  with  the  per¬ 
formance  data.  Measurements  under  different  stick  gains  also  provide  strong 
evidence  of  a  motor  remnant  source.  Overall,  these  results  generally  indi¬ 
cate  that  vibration  interference  is  related  to  relative  motions  of  eye,  head, 
and  limbs  with  respect  to  platform  motion;  and  several  component  biodynamic 
and  control  theory  models  are  suggested  which  should  be  capable  of  predicting 
the  performance  manifestations  of  these  effects. 


INTRODUCTION 

The  reliable  performance  of  manual  control  tasks  is  important  to  the 
aerospace  mission,  but  often  times  these  tasks  must  be  performed  under  adverse 
environmental  stresses.  Vibration  is  one  of  the  more  common  stresses  which 
degrades  manual  control  performance  (Ref.  l),  and  it  is  desirable  to  determine 
the  underlying  causes  of  interference  so  that  performance  effects  can  be 
extrapolated  to  new  situations. 


‘Performed  in  part  under  Contract  F336l 5-73-0-4003  for  the  6570th  Aero¬ 
space  Medical  Research  Laboratory  with  Lt.  Phil  Houck  as  Contract  Monitor, 
with  additional  work  supported  by  the  Air  Force  Office  of  Scientific  Research, 
under  the  cognizance  of  Col.  W.  Wisecup  of  the  Life  Sciences  Division. 

Senior  Research  Engineer,  Senior  Research  Engineer,  and  Principal  Research 
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Vibration  effects  are  time  dependent.  Short-term  exposures  lead  mainly 
to  biomechanical  interference  with  task  performance;  fatigue  and  behavioral 
accomodation  factors  become  important  for  longer  exposures;  while  chronic 
exposures  can  lead  to  physiological  accomodation  or  deterioration  as  in  some 
occupational  diseases.  The  direct  biomechanical  interference  of  vibration 
will  always  underlie  longer  term  effects,  however,  and  the  purpose  of  the 
research  reported  here  was  to  determine  the  basic  interference  mechanisms 
affecting  manual  control,  develop  component  models  for  the  various  phenomena 
involved,  and  eventually  to  put  together  overall  task  performance  models  which 
explain  the  short-term  effects  of  vibration  on  manual  control  performance. 

The  explanation  of  the  short-term  vibration  effects  will  then  provide  a 
theoretical  construct  from  which  to  evaluate  longer-term  effects. 

APPROACH  AND  METHODS 

Control  theory  based  measurement  and  modeling  techniques  are  used  in 
this  research  to  describe  both  the  detailed  dynamic  response  manifestations 
of  vibration  interference  and  the  resulting  performance  effects.  This  approach 
has  been  described  previously  (Ref.  2)  and  is  sumarized  in  Fig.  1  .  The  manual 
control  system  has  two  external  inputs,  the  traditional  tracking  input  command 
(i)  and  a  mechanical  (vibration)  disturbance  which  enters  through  the  body 
and  control  stick  (v).  Inputs  internal  to  the  operator  (remnant)  are  also 
generated  at  his  perceptual  input  (ne'i  and  motor  output  (nc)  which  are  a 
function  of  task  variables  and  vibration  interference. 

Given  the  above  inputs  the  composition  of  the  error  and  control  stick 
signals  are  then  determined  by  the  operator's  visual-motor  response  (Yp),  the 
machine  dynamics  he  is  controlling  (Yc),  the  vibration  feedthrough  dynamics 
(Yv),  and  the  two  remnant  sources  ($nne  and  ®nnc) •  For  simplicity,  the  dyna¬ 
mics  and  motor  remnant  are  shown  as  separate  blocks  in  Fig.  1;  as  will  be 
shown  subsequently,  each  process  is  highly  coupled,  however,  both  biomechani- 
cally  and  in  a  signal  processing  sense. 

For  measurement  purposes  the  approach  of  Fig.  1  allows  the  error  and 
stick  signals  to  be  partitioned  into  a  linear  sum  of  spectral  components  as 
shown  in  the  bottom  of  Fig.  1  and,  consequently,  the  variances  of  these 


signals  can  be  partitioned  in  the  same  manner.  Thus,  in  experiments  we  can 
consider  vibration  effects  on  the  various  signal  components,  and  for  modeling 
separate  component  models  can  be  set  up  which  when  summed  together  give 
overall  performance  measures  of  vibration  effects  on  the  manual  control 
system. 

The  data  considered  in  this  paper  cover  two  experiments,  one  involving 
sinusoidal  vibration  at  frequencies  2,  3-5,  5,  7,  and  10  Hz,  the  other  invol¬ 
ving  quasi-random  vibration  composed  of  a  sum  of  these  five  frequencies  with 
four  different  amplitude  envelopes  (Ref.  4).  The  range  of  frequencies  included 
is  typical  of  aircraft  buffet  and  structural  mode  excitation  and  also  brackets 
the  human  operator's  whole-body  resonance  mode. 

In  the  research  reported  here  subjects  performed  a  pitch  attitude  control 
task  with  a  CRT-displayed  artificial  horizon  and  a  center  stick  control.  The 
stick  force  gradient  turns  out  to  be  an  important  variable,  influencing  both 
motor  remnant  and  vibration  feedthrough;  and  in  the  sinusoidal  study  two 
extremes  of  stick  restraint  were  used:  minimal  ("spring"  stick)  and  near 
rigid  ("stiff"  stick).  Only  the  stiff  stick  was  used  in  the  randan  experi¬ 
ment.  The  controlled  element  dynamics  were  equivalent  to  the  short-period 
response  of  a  large  aircraft  and  are  given  in  Fig.  1.  The  dynamics  had 
appreciable  lag  requiring  significant  lead  generation  by  the  human  operator 
so  that  this  aspect  of  the  human  operator's  visual-motor  response  could  be 
checked  under  vibration. 

A  substantial  subject  population  was  used  in  each  experiment  (8  in  the 
sinusoidal  study,  6  in  the  random),  r.nd  the  subjects  were  well  trained  before 
the  formal  data  sessions.  Suitable  precautions  were  taken  to  avoid  procedural 
bias  in  the  results,  including  random  ordering  and  counterbalancing,  and  the 
final  results  were  statistically  analyzed  to  determine  the  reliability  of  the 
data. 

Performance  and  human  operator  describing  functions  were  measured  on-line 
during  the  tests  with  analog  computing  equipment  (Ref.  2).  During  the  sinu¬ 
soidal  study  biomechanical  response  measurements  were  also  obtained  on-line. 

For  the  random  study  cross-spectral  measurements  were  obtained  off-line  using 
a  General  Radio  TD  1923  spectral  analyzer. 
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OVERALL  PERFORMANCE  EFFECTS 
Partitioned  Performance  for  Sinusoidal  Vibration 

Partitioned  error  and  control  variances  averaged  over  8  subjects  under 
sinusoidal  vibration  are  given  in  Fig.  2.  For  tne  spring  stick  control 
errors  are  generally  elevated  over  static  levels  for  all  frequencies  with 
a  slight  peaking  in  the  region  of  7  Hz.  Fcr  the  stiff  stick  errors  are 
increased  only  at  higher  frequencies  (j  and  10  Hz)  which  is  the  region  in 
which  reports  of  visual  blurring  were  received.  Thus,  increase  in  remnant 
in  this  region  is  felt  to  be  due  to  a  visual  source. 

Control  variance  is  increased  at  low  frequencies  for  the  spring  stick 
and  at  high  frequencies  for  the  stiff  stick.  These  effects  are  mainly  due 
to  remnant,  as  noted  in  Fig.  2,  and  the  magnitude  of  remnant  seems  to  corre¬ 
late  with  the  amount  of  vibration  feedthrough  in  the  control  stick  output. 
Although  there  is  not  a  great  deal  of  absolute  feedthrough  in  the  case  of  the 
spring  stick,  there  is  evidence  of  considerable  vibration-correlated  limb 
motion,  and  it  will  subsequently  be  explained  how  this  may  lead  to  proprio¬ 
ceptive  induced  motor  remnant  (pp.  18-21). 

Overall,  the  results  in  Fig.  2  indicate  that  spring  stick  errors  are 
influenced  by  motor  remnant  at  low  frequencies  (2-5  Hz)  and  visual  remnant  at 
higher  frequencies  (7-10  Hz),  whereas  the  stiff  stick  is  affected  by  both 
types  of  remnant  at  high  frequencies.  Input  correlated  errors  determined  by 
the  operator's  visual-motor  response,  Yp,  increase  slightly  at  high  frequen¬ 
cies.  This  is  most  likely  due  to  the  operator's  awareness  of  visual  remnant 
(blurring)  and  probably  represents  an  adaptive  response  to  a  lower  closed- 
loop  bandwidth  in  order  to  minimize  the  effect  of  internal  noise  as  will 
be  shown  subsequently  (pg.  25).  Finally,  no  vibration  feedthrough  shows 
up  in  the  error  variance  as  it  is  filtered  out  by  Yc  before  it  reaches  the 
error  point. 

Stick  Electrical  Gain  Effects  Under  Random  Vibration 

In  the  sinusoidal  experiment,  stick  gain  was  purposely  set  at  a  level 
on  the  low  side  of  optimum  (based  on  subjective  opinion)  in  order  to  avoid 
any  undue  sensitivity  to  vibration  interference.  Ordinarily,  tracking 
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performance  is  optimum  over  a  very  broad  range  of  stick  gains  (Ref.  5). 

This  situation  changes  radically  under  vibration,  however,  as  demonstrated 
by  results  from  the  randan  experiment  given  in  Fig.  3.  Under  static  condi¬ 
tions  performance  stays  relatively  constant  over  a  gain  increase  of  10  times> 
however,  under  bandpass  vibration  centered  at  5  Hz,  the  error  remnant 
increases  radically.  An  example  of  partitioned  control  spectral  density 
for  one  run  is  shown  in  Fig.  4.  The  vibration  feedthrough  is  essentially 
the  same  for  either  electrical  stick  gain.  For  the  high  stick  gain  the 
operator  must  lower  his  gain  (force  output)  by  a  factor  of  10  times  to 
maintain  an  equivalent  loop  closure,  and  this  shows  up  in  the  lowered 
input  correlated  components.  The  remnant  goes  down  for  the  higher  stick 
gain  although  not  as  much  as  the  input  correlated  components.  However, 
remnant  has  at  least  two  sources  as  indicated  in  Fig.  1  where  the  expres¬ 
sion  for  4>cc  shows  that  the  part  of  the  remnant  dependent  on  4nne  also 
depends  directly  on  Yp.  The  middle  part  of  Fig.  1  indicates  that  $nng 
varies  directly  with  oe 2  and  since  this  increases  (see  Fig.  3  for  0.28  g  rms) 
for  the  high  stick  gain  we  would  expect  this  to  counteract  part  of  the 
remnant  decrease  due  to  the  Yp  reduction.  The  analysis  of  the  data  base 
(ongoing  at  the  time  of  this  writing)  provides  the  first  direct  evidence 
of  vibration-induced  motor  remnant  as  the  remnant  level  is  influenced  by 
mechanical  forces  at  the  control  stick,  rather  than  depending  totally  on 
visual  remnant  sources. 

COMPONENT  EFFECTS  AND  MODELS 
Visual-Motor  Response 

The  visual-motor  response  properties  of  the  human  operator  have  been  well 
established  and  modeled  under  static  conditions  (Refs.  5  and  6),  and  in  this 
research  we  have  used  a  "precision  model"  form  to  fit  describing  function 
data  and  to  describe  vibration  effects.  For  every  run  taken  in  both  the 
sinusoidal  and  random  vibration  experiments  a  model  curve  fit  was  made  as  a 
part  of  the  data  reduction. 
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For  the  stiff  stick  control  Fig.  >  shows  an  example  of  the  effect  of 
vibration  on  the  pilot's  describing  function  data  (averaged  over  7  subjects 
by  2  repretitions) .  Also  shown  are  the  curve  fits  that  result  from  using 
the  averaged  precision  model  parameters.  Basically,  the  human  operator's 
midband  gain,  K*,  decreases  under  vibration,  which  probably  represents  an 
adaptive  response  to  minimize  the  effect  of  closed-loop  remnant  by  lower¬ 
ing  the  bandwidth  of  the  tracking  loop.  The  neurcmusuclar  system  natural 
frequency,  ajj,  also  decreases,  although  this  effect  has  much  less  influence 
on  performance  since  the  frequency  of  this  mode  is  well  past  the  closed- 
loop  bandwidth  of  the  tracking  loop. 

Statistical  analysis  of  the  model  parameters  showed  that  only  the 
human  operator  midband  gain,  K^,  and  neuromuscular  system  natural  frequency, 
oqj,  were  significantly  effected.  Surprisingly  enough,  vibration  did  not 
affect  the  operator's  lead,  T&,  generating  capability,  which  depends  on  per¬ 
ceiving  error  rates,  even  though  visual  blurring  was  reported  at  7  and 
10  Hz  (which  might  be  expected  to  degrade  error  rate  estimates).  Statistical 
analysis  of  the  model  parameters  obtained  in  the  random  experiment  also 
showed  that  only  and  were  significantly  affected  (Ref.  4). 

Biomechanical  Response 

The  mechanical  interference  of  vibration  on  manual  control  is  determined 
in  large  part  by  the  operator's  biomechanical  response .  This  is  a  factor  in 
the  vibration  feedthrough  dynamics,  Yv  (Fig.  l),  as  well  as  a  factor  in  the 
generation  of  remnant  which  will  be  discussed  subsequently. 

The  structural  elements  of  a  biomechanical  model  pertinent  to  a  seated 
pilot  performing  a  pitch  control  task  under  vertical  vibration  are  illustrated 
in  Fig.  6.  The  general  seating  position,  lap  and  shoulder  belts,  and  nominal 
arm  angles  are  shown  on  the  left.  On  the  right  the  arm  segments  are  shown 
for  positive  values  of  their  nominal  position  angles,  9^,  and  9a.  The  arm 
segments  are  assumed  to  have  pin  joints  at  the  shoulder,  elbow,  and  wrist 
and  to  be  restrained  by  neuromuscular  systems  (a  passive  system  at  the  elbow 
and  an  active  system  at  the  shoulder  that  respond  to  central  commands  as  well 
as  force  or  displacement  feedback).  The  details  of  the  active  neuromuscular 
system  will  be  discussed  subsequently.  The  passive  neuromuscular  restraint 
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Figure  6.  Gz  Torso/Arm  Linkage/Stick  Biomechanical  Model 


reflects  the  small  signal  perturbation  elements  for  an  agonist/antagonist 
muscle  pair  as  developed  in  Ref.  7.  For  the  wrist/hand/stick  system  there  is 
provision  for  equivalent  lumped  interface  compliance  and  damping,  and  the 
control  stick  has  the  usual  force  feel  characteristics  of  mass,  compliance, 
and  damping  restraining  fore-aft  stick  motion.  Torso  motions  are  modeled  by 
a  mass  (constrained  to  vertical  motions  only  based  on  movies  of  subjects  under 
vibration)  restrained  by  a  simple  spring  and  damper.  Reference  11  found  that 
this  simplest  possible  model  gave  an  adequate  description  of  shoulder  response 
to  platform  acceleration. 

Assuming  all  arm  segments  are  in  planar  motion  the  small  perturbation 
equations  of  motion  were  written  and  put  on  a  timesharing  computer  program 
that  writes  a  set  of  simultaneous  equations  from  a  file  of  raw  parameter 
values  (measured  stick  restraints,  muscle  descriptors.  Refs.  7  and  8,  and 
arm/torso  masses  and  inertias  from  cadaver  data,  Ref.  9)*  A  systems  analysis 
library  program  (USAM,  Ref.  10)  is  then  used  to  solve  for  the  various  trans- 
missibilities  and  feedthroughs  of  interest. 

Before  examining  seme  preliminary  results,  note  that  as  the  platform 
accelerates  upwards  vibration  feedthrough  to  the  stick  results  from  two 
sources: 

•  Shoulder  motion  downward  relative  to  the  platform 
which  tends  to  push  the  stick  forward. 

•  Inertial  reaction  of  the  arm  segments  which  tends 
to  pull  the  stick  back. 

These  effects  will  be  illustrated  in  the  next  three  figures. 

Figure  7  shows  vertical  shoulder  acceleration  averaged  over  eight  subjects 
in  response  to  0.4  g  peak  sinusoidal  vibration  for  both  spring  and  stiff 
sticks.  The  small  transmissibility  differences  between  stick  types  indi¬ 
cate  that  the  different  control  stick  forces  (~15  N  for  stiff  stick  vs. 

2.46N*  for  spring  stick)  have  not  affected  shoulder  transmissibility.* 


*From  Fig.  2  compare  15  N  for  stiff  stick  with  (1.5  cm)  x  (0.64  N/cm)  = 
2.46  N  for  the  spring  stick  rms  force  levels. 
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Figure  7.  Vertical  Shoulder  Acceleration  Averaged  Over  Eight  Subjects 
(Sinusoidal  Vibration,  0.4  g  Peak) 


Also  shown  in  Fig.  7  is  a  curve  fit  to  the  peak  shoulder  transmissibility 
which  indicates  a  body  resonance  at  28  rad/sec  =  U.5  Hz,  very  close  to  the 
Ref.  11  results.  In  Fig.  7  we  have  also  shown  the  rhoulder  motion  relative 
to  the  platform  (as  -  ap)  which  is  an  important  factor  in  vibration  feed¬ 
through.  This  indicates  very  little  relative  motion  at  2  Hz  but  rapidly 
increases  above  that  to  a  peak  at  whole  body  resonance  with  a  remaining 
high  level  thereafter. 

Figure  8  illustrates  typical  spectral  and  cross- spectral  measurements 
under  a  quasi-random  sum  of  5  sine  waves  vibration.  The  5  input  components 
were  set  by  oscillators  rather  than  precision  equipment,  thus  the  acceleration 
spectrum  appears  to  have  power  near  each  component  rather  than  appearing  "clean" 
as  does  the  5  Hz  component  which  evidently  fell  exactly  on  5  Hz.  The  shoulder 
shoulder  acceleration  spectrum  reveals  no  significant  nonlinearities,  the 
coherence  is  near  unity  at  the  5  frequencies,  and,  finally,  the  shoulder 
transmissibility  magnitude  and  phase  are  consistent  with  the  curve  fit  from 
the  sine  wave  experiment  (Fig.  7)  where  each  frequency  was  presented  in  a 
separate  run. 

The  single  run  shown  in  Fig.  8  indicates  that  superposition  holds  between 
the  sinusoidal  and  random  vibration  data  in  the  major  data  trends.  We  are  in 
process  of  examining  and  interpreting  further  random  data  over  a  range  of 
subjects  and  vibration  input  spectral  shapes  so  as  to  evaluate  the  degree  of 
consistency  in  torso  transmissibility  measurements. 

Figure  9  shows  stick  response  to  platform  acceleration  measurements  from 
the  sinusoidal  experiment  averaged  over  seven  subjects  for  spring  and  stiff 
sticks.  The  feedthrough  amplitude  with  the  stiff  stick  is  highest  at  high 
frequencies,  whereas  it  is  highest  at  lower  frequencies  with  the  spring 
stick.  Also  shown  in  Fig.  9  are  oversimplified  biomechanical  model  (Fig.  6) 
responses  (using  each  stick's  spring  gradient)  for  the  following  conditions: 

•  The  same  level  of  muscle  stiffness  used  in  each  case. 

•  Interface  locked  up  (Ki  =  »). 

•  No  passive  neuromuscular  restraint  at  the  elbow. 

•  Active  neuromuscular  system  replaced  by  a  passive  system. 
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•  Shoulder  motions  not  loaded  down  by  arm  linkage 
forces,  i.e.,  shoulder  motion  is  a  pure  position  input. 

•  9a  =  “15°,  0!  =  ^5°  (Fig.  6) 

Both  curves  exhibit  the  shoulder  transmissibility  mode  (u$)  as  well  as 
the  limb  reaction  effect  which  shows  up  as  one  right  and  one  left  half 
plane  zero  ( 1 /Ta1 >  I/TA2'  near  UO  rad/sec.  The  non-minimum  phase  zero  is 
the  cause  of  both  phase  curves  starting  at  +180  deg  at  low  frequency. 

The  curve  fit  to  the  spring  stick  data  is  quite  good  whereas  the  fit 
to  the  force  stick  data  is  fine  in  phase  but  not  in  amplitude.  This  is 
probably  due  partly  to  the  interface  being  assumed  locked  which  should  be 
reasonable  for  the  weak  spring  stick  gradient  (Ks  =  164  N/m)  but  not  for 
the  stiff  stick  gradient  (Ks  =  139°0  N/m).  An  interface  gradient  much 
larger  than  that  of  the  spring  stick  but  less  than  that  or  the  stiff  stick 
along  with  interface  damping  will  tend  to  decouple  the  stiff  stick  results, 
producing  less  feedthrough  at  lower  frequencies.  Other  factors  not  included 
in  the  preliminary  fits  in  Fig.  9  are  the  effects  of  the  active  neuromus¬ 
cular  system,  possible  anthropometric  differences,  and  possible  differences 
between  results  from  single  sine  wave  vibrations  and  quasi-random  sums  of 
sine  waves  results.  At  this  point  in  time  we  are  examining  the  large  data 
bank  of  spectral  and  cross- spectral  results  to  evaluate  the  above  effects. 

Visual-Motor  Biodynamic  Model 

The  details  of  the  "active  neuromuscular  system"  used  in  Fig.  6  are  given 
in  Fig.  10,  the  visual-motor  biodynamic  model.  At  the  far  right  is  the  muscle 
insertion  into  upper  arm  (Fig.  6).  Tendon  compliance  connects  the  bone  to  the 
equivalent  muscle  model  for  the  agonist/antagonist  muscle  pair  involved  in 
torquing  the  upper  arm  (Ref.  7).  New  features  are  the  series  clastic  damp¬ 
ing,  Be  (Ref.  12),  and  the  force  activation  dynamics  (to  be  discussed  in  a 
later  paragraph). 

The  spinal  cord  receives  feedbacks  as  well  as  central  commands  arising 
from  visual  Inputs.  The  processed  visual  inputs  have  noise  ("processing 
remnant,"  Refs.  5  and  6),  much  of  which  scales  with  the  variance  of  the 
perceived  signal  and  is  sometimes  referred  to  as  observation  noise  (Refs.  13-15). 
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Tne  spindle  feedback  models  reflect  our  interpretations  of  Refs.  7,  8, 
22-29.  The  intrafusal  fibers  have  dynamics  similar  to  the  extrafusal  fibers 
of  the  muscle  model.  The  bias  also  serves  to  set  the  lead/lag  (?sp,  Psp) 
values  as  well  as  provide  a  bias  to  keep  the  muscles  under  an  average  tension 
which  helps  set  some  of  its  parameters  (this  path  is  not  shown  in  Fig.  10). 

The  spindle  sensor  lead  appears  to  be  at  rather  high  frequency  ( U0-^0  rad/sec, 
Ref.  22)  but  may  saturate  for  anything  but  small  perturbations.  The  Golgi 
feedback  reflects  a  describing  function  interpretation  of  some  transient 
responses  found  in  Ref.  17. 

In  Fig.  10  we  have  postulated  three  "motor"  remnant  sources  each  injected 
at  the  input  to  a  specific  box  (much  as  the  processing  remnant  is  injected 
at  the  front  end  of  the  pilot).  The  spindle/muscle  noise  source  reflects 
possible  gamma  bias  time  variations  as  well  as  intrafusal  muscle  fiber  noise. 
The  spindle  sensor  noise  reflects  possible  sensor  variations  due  to  spindle 
tension  variations  as  well  as  saturation  effects  for  the  larger  amplitudes 
that  are  induced  by  vibration.  Similarly,  a  possible  force  sensing  noise 
is  shown  referred  to  the  input  to  the  Golgi  feedback. 

The  force  activation  dynamics  (Fig.  10)  were  first  proposed  in  Ref.  16 
to  explain  the  describing  function  measurements  for  the  forward  path  of  the 
neuromuscular  system  dynamics,  G^,  between  aa  (Fig.  10)  and,  c,  the  stick 
response  (Fig.  6).  These  results  (Fig.  11 )  were  reported  in  Refs.  8  and  6. 
For  the  cross- spectral  ratios  shown  in  Fig.  11  the  i  signal  is  the  track¬ 
ing  input  (Fig.  l)  and  the  x  signal*  corresponds  to  the  aa  signal  of 
Fig.  10.  Note  that  the  results  from  the  cross- spectral  ratios  taken  with 
respect  to  the  sum  of  sine  waves  input,  i,  give  the  same  results  as  those 
with  respect  to  the  x  signal  which  is  within  the  closed  loop  system  and 
contains  remnant  that  is  circulating  around  the  loop.  This  implies  that 
there  axe  no  signficant  remnant  sources  between  the  alpha  motorneuron  signals, 

and  the  stick  response.  Further,  note  that  essentially  the  same  dynamics 
result  for  both  rudder  pedals  and  hand  manipulator  despite  the  large  dif¬ 
ference  in  limb  size. 

*0btained  from  processing  EMG  signals  by  bandpass  filtering,  then  full 
wave  rectifying,  and  then  low  pass  filtering,  to  obtain  the  effective 
muscle  driving  signal.  The  difference  between  agonist  and  antagonist 
muscle  processed  EMG  signals  then  forms  x. 
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Figure  10.  Visual-Motor  Biodynamic  Model 


That  the  major  portion  of  the  muscle/manipulator  rolloff  must  be  force 
activation  dynamics  rather  than  just  the  effect  of  limb  mass  on  stick 
spring  gradient,  was  verified  by  applying  the  biomechanical  model  (Fig.  6) 
to  the  rudder  pedal  geometry  of  Ref.  8.  The  resulting  natural  frequency 
was  >45  i ad/sec  for  any  degree  of  muscle  stiffness  and  damping.  Since  the 
break  frequencies  in  Fig.  11  (and  other  configurations  in  Ref.  8)  are  on 
the  order  of  10  rad/sec  for  both  rudder  pedals  and  hand  manipulators,  these 
breaks  cannot  be  biomechanical  in  nature.  Hence  we  have  postulated  the 
presence  of  force  activation  dynamics  (which  is  consistent  with  the  active 
state  interpretation  in  Ref.  21). 

Under  static  conditions  there  has  been  little  need  for  a  "motor"  remnant 
source  (Refs.  6,  15,  19,  20)  as  shown  on  the  upper  left  side  of  Fig,  12. 

For  the  control  spectrum  the  precision  model  fits  the  correlated  components 
and  processing  remnant  fits  essentially  all  the  remnant.  Under  vibration 
(upper  right)  the  precision  model  also  fits  the  correlated  components  but 
the  processing  remnant  model  only  fits  up  to  about  1.4  Hz  as  the  actual 
remnant  has  less  rolloff  at  high  frequency.  The  processing  remnant  model 
comparison  (lower  left  of  Fig.  12)  shows  the  effects  of  vibration  on  the 
processing  remnant  pathway.  From  Fig.  5  vibration  causes  a  reduction  in 
the  pilot's  midband  gain  and  neuromuscular  system  natural  frequency.  The 
closed  visual  loop  consequence  of  the  gain  reduction  is  a  lower  with 
larger  damping.  The  closed  visual  loop  consequence  of  the  neuromuscular 
system  natural  frequency  reduction  is  a  drop  in  the  pass  band  of  the  pro¬ 
cessing  remnant  pathway. 

We  are  not  at  this  time  concluding  anything  about  the  degree  to  which 
the  processing  remnant  scales  with  the  variance  of  the  error  (Figs.  1  and 
10)  as  we  are  still  in  the  process  of  untangling  effects  across  the  data 
base.  In  particular,  we  will  be  examining  the  motor  remnant  sources 
(Fig.  10)  especially  the  consequences  of  spindle  sensors  and  spindle  muscle 
noise  sources,  as  these  go  through  one  and  two  lead  terms,  respectively, 
before  they  get  to  the  spinal  cord.  Hence  they  are  likely  to  have  less 
high  frequency  rolloff,  thus  providing  a  possible  explanation  of  the  high 
frequency  remnant  when  vibration  is  present. 
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Visual  Remnant:  Head  Motion  Model  and  Measures 

As  indicated  previously  (pg.  5)  both  performance  measurements  and 
subjective  reports  suggest  vibration  interference  with  vision  out  in  the 
region  of  7-10  Hz,  which  at  these  frequencies  is  probably  due  to  head 
motions  rather  than  any  direct  effect  on  the  eyeball  itself  (e.g.,  resonance, 
distortion,  etc.).  A  block  diagram  model  indicating  the  influence  of  head 
motions  on  retinal  image  motion  is  given  in  Fig.  13a.  At  low  frequencies 
(<4  Hz)  feedbacks  to  the  occulanotor  system  tend  to  stabilize  the  eye  line 
of  sight  (Ref.  18)  such  that  a  constant  eye  point  of  regard  can  be  maintained 
during  normal  head  motions  (such  as  caused  by  walking,  gesturing,  etc.). 
Beyond  the  occulanotor  bandwidth  the  eye  no  longer  compensates  for  head 
motion,  however,  at  which  point  the  eye-point- of- regard  follows  head  motions. 
Thus  head  motions  beyond  4  Hz  tend  to  disturb  vision. 

During  the  sinusoidal  experiment,  measurements  on  both  head  rotation 
and  translation  were  obtained  (with  two  accelerometers  mounted  on  a  simple 
bite  bar  clenched  in  the  teeth)  in  order  to  determine  their  correlation 
with  other  data  on  visual  disturbance.  As  shown  in  Fig.  13b  both  head 
translation  (measured  near  the  eye)  and  head  rotation  accelerations  peak 
in  the  region  of  7  Hz.  These  data  were  also  computationally  projected 
out  to  the  display  plane  to  determine  the  apparent  relative  motion  of 
display  images  caused  by  relative  head/display  motion.  As  shown  at  the 
bottom  of  Fig.  13b  head  rotation  caused  the  major  contribution  to  apparent 
display  image  motion. 

Given  vibration  induced  retinal  image  motions,  there  are  still  many 
perceptual  factors  (such  as  perceptual,  blanking,  displacement  vs.  velocity 
of  motion,  etc.)  that  combine  to  determine  visual  interference.  However, 
as  suggested  by  the  present  data,  head  motions  are  certainly  a  key  factor, 
and  development  of  a  biomechanical  head  motion  model  will  be  pursued  as  a 
key  factor  in  describing  vibration  interference  with  vision. 

CONCLUDING  REMARKS 

In  recent  years  we  have  explored  the  basic  mechanisms  of  vertical 
vibration  interference  with  manual  control  performance  using  the  combined 
approach  of  experimental  studies  and  model  development.  Preliminary  models 


Figure  13.  Head  Motion  Model  and  Measurements 


were  used  to  suggest  appropriate  experimental  measurements,  and  based  on 
these  measurements  the  models  are  now  in  the  process  of  further  refinement. 
Model  developments  thus  far  have  indicated  that  most  vibration  effects 
arise  from  the  relative  motions  of  various  body  parts  with  respect  to  the 
seat,  stick  and  display.  The  modeling  effort  has  also  shown  how  compli¬ 
cated  the  interaction  is  between  body,  arm  and  stick  motions. 

Evidence  is  presented  for  the  presence  of  motor  noise,  and  appropriate 
structural  models  for  the  limb/neurcmuscular  system  are  suggested  which 
should  allow  modeling  the  sources  of  motor  noise.  Motor  remnant  is  an 
important  factor  at  high  control  stick  gains,  and  this  connection  will  be 
studied  further.  Ultimately  we  hope  to  have  a  complete  performance  model, 
explaining  feedthrough,  remnant,  and  adaptive  visual-motor  covariations  as 
affected  by  vibration.  This  effort  will  be  greatly  aided  by  our  use  of 
structurally  related  models  which  contain  the  natural  covariations  of 
vibration  induced  effects. 

While  the  models  presented  here  are  structurally  complete,  they  are 
also  more  complicated  than  may  be  required  in  specific  design  and  analysis 
situations.  Once  the  important  aspects  of  the  models  are  uncovered,  however, 
they  can  be  greatly  simplified  for  various  applications.  Part  of  the  on¬ 
going  modeling  effort  will  be  devoted  to  developing  simplified  model  forms. 

Some  potential  applications  of  biodynamic  models  are  shown  in  Fig.  1^ 
which  include  both  analysis  and  design  situations  involving  the  visual, 
control  and  seat  interfaces  with  the  human  operator. 
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ABSTRACT 

The  effects  of  whole-body  sinusoidal  vibration  on  pilot 
remnant  are  analyzed.  Data  for  one  test  subject,  five  vibration 
conditions,  and  one  control  configuration  are  considered.  The 
primary  effect  of  vibration  on  the  remnant  spectrum  is  to  increase 
the  overall  remnant  level >  no  important  changes  in  spectral  shape 
are  ascertained.  Vibration- induced  remnant  can  be  modeled  as  an 
injected  wide-band  motor  noise  process  that,  for  the  most  part, 
varies  proportionally  with  stick  variance.  A  model  structure 
for  relating  pilot  performance  to  vibration  parameters  is 
suggested. 


INTRODUCTION  AND  SUMMARY 


Objectives 

The  effects  of  sinusoidal  whole-body  vibration  on  manual 
tracking  performance  have  recently  been  reported  by  Allen  et  al. 
in  [1].  As  tracking  performance  in  vibration  environments  has 
not  heretofore  been  analyzed  to  the  level  of  detail  reported  by 
these  investigators,  this  effort  must  be  regarded  as  a  consi¬ 
derable  advance  towards  understanding  the  effects  of  vibration 
on  manual  control  behavior. 

The  ultimate  objective  of  studying  laboratory  tracking 
performance  in  vibration  environments  is  to  develop  a  body  of 
knowledge  that  will  allow  one  to  minimize  and/or  compensate 
for  the  effects  of  vibration  in  operational  situations  requiring 
manual  control.  This  objective  would  be  materially  aided  by  the 
development  of  analytic  models  to  describe  the  interrelationships 
between  vibration  parameters,  physical  characteristics  of  the 
pilot/vehicle  interface,  vehicle  dynamic  response  properties, 
pilot  response  strategy,  and  overall  system  performance. 

Although  the  study  reported  in  11]  provides  a  good  step  in  this 
direction,  a  number  of  gaps  in  our  understanding  remain.  Speci¬ 
fically,  the  published  data  do  not  show  in  a  quantitative  fashion 


why  the  vibration  disturbances  affect  tracking  performance  the 
way  they  do.  That  is,  cause  and  effect  are  not  well  defined. 

Rather,  the  results  are  more  of  a  descriptive  nature  in  the 
sense  that  a  "catalog"  of  vibration  parameters  and  changes  in 
certain  system  performance  measures  and  pilot  response  para¬ 
meters  is  developed.  Nevertheless,  these  results,  plus  the 
bio-mechanical  models  developed  in  the  same  study,  provide  a 
solid  basis  for  further  model  development. 

Additional  analysis  of  the  data  obtained  by  Allen  et  al. 
was  performed  by  Levison  to  obtain  a  more  detailed  description 
of  the  interaction  between  vibration  and  tracking  performance. 

The  results  of  Levison' s  study  are  summarized  in  this  paper  and 
are  reported  in  greater  detail  in  [2).  Some  of  the  specific  goals 
of  the  latter  study  were  to  (a)  determine  pilot  describing  functions 
and  remnant  spectra  for  various  vibration  conditions,  (b)  ascertain 
the  sources  of  vibration-induced  remnant  via  model  analysis,  and 
(c)  suggest  a  means  for  quantitative  prediction  of  pilot  remnant 
and  system  performance  in  vibration  environments. 


Background 

Tracking  performance  for  a  variety  of  tracking  situations 
and  vibration  conditions  was  observed  in  the  study  performed  by 
Allen  et  al.  The  results  of  the  experiments  with  lateral  vibra¬ 
tion  inputs  are  reviewed  here,  as  these  provided  the  data 
examined  subsequently  by  Levison. 

Sinusoidal  whole-body  vibration  at  six  frequencies  (applied 
singly)  was  explored,  along  with  the  static  (i.e.,  no-vibration) 
condition.  Zero-to-peak  acceleration  was  0.4g  for  each  vibration 
test  signal.  A  single  set  of  controlled-element  dynamics,  simu¬ 
lating  aircraft  roll  response,  was  used. 

Two  variations  of  control-stick  properties  were  studied 
in  this  experimental  program.  A  "stiff  stick"  configuration  was 
designed  to  provide  essentially  an  isometric  control  device,  and 
a  "spring  stick"  was  provided  with  a  very  light  spring  gradient. 

Various  tracking  performance  measures  were  obtained, 
including  (a)  variance  scores  for  tracking  error  and  control 
activity,  (b)  measures  of  "coherence"  to  indicate  the  fraction 
of  total  error  and  control  power  correlated  with  the  tracking 
input  signal,  and  (c)  pilot  describing  functions  were  analyzed 
to  yield  various  descriptions  of  the  pilots'  tracking  strategy 
such  as  "gain-crossover"  and  "phase-crossover"  frequencies. 
Remnant  spectra  were  not  obtained,  however;  hence  the  need  for 
further  analysis  of  the  experimental  data. 
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The  correlation  between  the  pilot's  control  input  and  the 
vibration  input  was  computed  in  order  to  determine  the  extent 
of  difect  mechanical  feedthrough  from  vibration  to  tracking 
error.  In  addition,  motions  of  the  head,  shoulder,  and  elbow 
were  recorded  so  that  a  model  for  the  mechanical  coupling  could 
be  developed. 

The  results  of  the  data  analysis  reported  in  [1]  regarding 
the  lateral  vibration  experiments  may  be  summarized  as  follows: 

1.  Vibration  had  a  much  greater  effect  on  tracking 
error  when  the  relatively  free-moving  spring  stick 
was  used. 

2.  Performance  degraded  increasingly  with  decreasing 
vibration  frequency.  Maximum  increase  in  error 
coincided  with  maximum  body  response  to  the 
vibration  input. 

3.  The  increase  in  tracking  error  was  apparently  due 
primarily  to  increased  pilot  remnant.  Changes  in 
describing  function  parameters  were  relatively  small. 

4.  Pilot  commentary,  as  well  as  consideration  of  the 
above  results,  suggested  that  motor- related  sources 
of  remnant  were  dominant  in  the  lateral-vibration 
experiments. 

5.  Mechanical  transmission  between  vibration  input 
and  various  parts  of  the  body  was  studied,  and 
relatively  simple  models  were  constructed  to 
describe  the  mechanical  coupling  between  vibra¬ 
tion  input  and  control. 


Data-Base 

The  analytical  study  reported  in  this  paper  was  intended  to 
be  a  small-scale  effort  to  explore  the  nature  of  vibsat ion- induced 
remnant  and  to  suggest  some  tentative  modeling  approaches.  Accor¬ 
dingly,  only  a  limited  portion  of  the  data  obtained  in  the  experi¬ 
mental  study  of  Allen  et  al.  was  explored  in  this  regard. 

Analysis  was  confined  to  data  obtained  from  a  single  test 
subject  using  the  spring  stick.  Analysis  of  error  and  stick 
variances  reported  in  (1]  was  performed  to  find  the  subject 
whose  performance  was  most  representative  of  the  four  subjects 
that  had  participated  in  the  experiments.  Data  for  the  static 
condition  and  for  vibration  frequencies  of  1.3,  2,  3,  and  4.5 
Hz  were  analyzed. 
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Conclusions 

The  major  conclusions  of  the  study  summarized  in  this  paper 
are  as  follows: 

1.  The  findings  reported  by  Allen  et  al.  regarding 
the  effects  of  lateral  vibration  on  tracking 
performance  are  confirmed. 

2.  The  primary  effect  of  vibration  on  the  closed-loop 
stick  remnant  spectrum  is  to  increase  the  overall 
level  of  remnant.  Consistent  changes  in  spectral 
shape  are  not  observed. 

3.  The  effect  of  vibration  on  pilot  behavior  and  system 
performance  can  be  largely  accounted  for  by  an  increase 
in  wide-band  motor-related  pilot  "noise"  for  the  spring- 
stick  experiments.  For  all  but  the  most  severe  vibra¬ 
tion  condition,  the  variance  of  the  injected  noise 
process  can  be  considered  to  vary  proportionally  with 
stick  variance. 

4.  A  combination  of  existing  models  for  pilot/vehicle 
performance  and  vibration  feedthrough  would  appear 
to  provide  a  powerful  tool  for  predicting  pilot 
behavior  and  system  performance  in  vibration 
environments. 


PRIMARY  DATA  ANALYSIS 

The  data  analyzed  in  this  study  have  been  reduced  to  provide 
signal  variances  and  standard  deviations,  pilot  describing  functions, 
and  spectral  density  functions  of  tracking  error  and  control  stick 
signals.  Computations  were  made  over  50-second  intervals  for  each 
experimental  trial.  The  measurement  intervals  used  in  this  study 
coincide  to  within  one  or  two  seconds  with  the  measurement  inter¬ 
vals  used  in  the  original  study  by  Allen  et  al. 

Performance  Scores 

Variance  and  standard  deviation  (SD)  scores  for  input,  error, 
and  stick  displacements  are  given  in  Table  1  for  the  five  vibration 
conditions  (including  the  static  condition).  Each  entry  represents 
the  average  of  three  replications  and  includes  the  effects  of  the 
tracking  input,  the  vibration  input,  and  pilot  remnant.*  Since 
the  average  SD  scores  were  obtained  by  averaging  the  individual 
SD  scores,  the  SD  scores  shown  in  Table  1  are  not  necessarily 
equal  to  the  square  root  of  the  average  variance  score. 


•"Remnant"  is  defined  in  this  study  as  signal  power  at  other 
than  input  frequencies. 


EFFECT  OF  VIBRATION  CONDITION  ON  PERFORMANCE  SCORE 


Average  of  3  Replications 


Vibration 

Condition 

Input 

Variance 

Error 

Stick 

Standard  Deviation (SD) 
Input  Error  Stick 

Static 

Ki 

1.65 

2.06 

2.06 

1.28 

1.42 

4.5  Hz 

mm 

1.67 

1.91 

2.06 

1.29 

1.38 

3.0  Hz 

m 

1.92 

9.71 

2.05 

1.38 

3.10 

2.0  Hz 

4.23 

3.76 

19.7 

2.06 

1.93 

4.48 

1.3  Hz 

4.23 

10.0 

34.1 

2.06 

3.15 

5.83 

Both  the  stick  and  error  scores  increase  progressively  with 
decreasing  vibration  frecuency.  The  percentage  changes  in  stick 
and  error  scores  fronf  one  frequency  condition  to  the  next  appear 
to  agree  quite  well  with  the  performance  scores  shown  *or  the 
test  subject  (Subject  BC)  in  Figures  25a  and  26a  of  [1], 

Stick  Remnant  Spectra 

Closed-loop  stick  remnant  spectra  are  shown  in  Figure  1  for 
the  static  condition,  the  most  severe  vibration  condition  (1.3  Hz), 
and  an  intermediate  vibration  condition  (3  Hz).  Each  datum  point 
presented  in  this  figure  reflects  the  average  of  remnant  estimates 
obtained  at  up  to  four  adjacent  measurement  frequencies.  These 
frequency-smoothed  estimates  have  been  averaged  across  three 
replications  for  each  condition.  The  data  shown  in  this  figure 
(and  in  all  subsequent  figures  in  this  paper)  have  been  norma¬ 
lized  to  represent  continuous  spectra  as  described  in  [2] . 

The  primary  effect  of  vibration  on  the  remnant  spectrum  is 
to  increase  the  overall  level,  rather  than  to  distort  the  frequency- 
dependency.  All  three  curves  show  a  peak  at  around  4-5  rad/sec 
with  a  fall-off  of  about  40  dB/decade  at  frequencies  above  the 
peak.  At  frequencies  below  the  peak,  the  remnant  spectrum  appears 
to  increase  with  frequency  by  roughly  20  dB/decade.  Since  the 
location  of  the  spectral  peak  appears  to  be  independent  of  the 
vibration  frequency,  the  peaking  effect  is  most  likely  a  con¬ 
sequence  of  the  closed-loop  system  characteristics  rather  than  a 
reflection  of  non-linear  feedthrough  of  the  vibration  input. 
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FIGURE  2.  Effect  of  Vibration  on  Stick  Remnant  Ratio 
Average  of  3  Replications 
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The  cross-hatched  point  associated  with  the  1.3  Hz  curve 
at  about  8  rad/sec  reflects  the  direct  feedthrough  of  the  vibration 
signal.  Otherwise,  the  shape  of  the  1.3  Hz  curve  is  similar  to 
that  of  the  other  remnant  spectra  shown  in  Figure  1. 

"Remnant  ratios"  for  four  of  the  five  conditions  explored 
are  shown  in  Figure  2.*  To  compute  each  of  these  curves,  remnant 
measurements  were  averaged  over  +  1/8  octave  about  each  input 
frequency  and  normalized  with  respect  to  the  spectral  estimate 
at  the  corresponding  input  frequency.  As  expected,  the  overall 
level  of  the  remnant  ratio  increases  with  the  severity  of  the 
vibration  condition.  Except  for  a  somewhat  greater  rate-of- 
change  of  remnant  ratio  with  freouency  for  the  static  condition, 
there  appears  to  be  no  consistent  effect  of  vibration  on  the 
shape  of  this  curve. 

Pilot  Describing  Functions 

Pilot  describing  functions  for  four  conditions  are  pre¬ 
sented  in  Figure  3.  Although  the  slope  of  the  amplitude-ratio 
curve  in  the  region  of  gain  crossover  appears  to  increase  with 
increasing  severity  of  vibration,  no  consistent  effects  of 
vibration  on  phase-shift  characteristics  are  observed.  Gain- 
crossover  frequencies  are  essentially  the  same  (about  2.6  rad/ 
sec)  for  all  four  conditions,  which  suggests  that  the  presence 
of  vibration  inputs  did  not  appreciably  affect  the  efficiency 
of  the  pilot/vehicle  system  with  respect  to  minimizing  the 
effects  of  the  tracking  input. 


MODEL  ANALYSIS 

Model  analysis  was  performed  to  help  identify  the  source  of 
vibration-induced  remnant  and  to  determine  whether  or  not  a 
straightforward  procedure  could  be  found  for  predicting  the 
effects  of  vibration  on  tracking  error. 

The  Pllot/Vehlcle  Model 

This  analysis  was  performed  with  the  state-variable  (or 
"optimal-control")  model  for  pilot/vehicle  systems  developed  at 
Bolt  Beranek  and  Newman  Inc.  The  model  is  based  on  the  assumption 
that  the  well-motivated  and  well-trained  human  operator  behaves  in 
a  near  optimal  manner  subject  to  his  inherent  constraints  and 


*Data  for  the  3  Hz  condition  were  omitted  from  this  figure  to 
maintain  readability.  The  shape  of  this  curve  was  similar  to 
that  of  the  4.5  Hz  condition,  with  a  somewhat  higher  overall 
level.  The  estimate  of  the  remnant  ratio  for  the  1.3  Hz  condi¬ 
tion  at  6.3  rad/sec  has  been  omitted  because  the  estimate  of 
input-correlated  power  at  this  frequency  did  not  meet  the  test 
or  reliability  defined  in  [2] . 
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FREQUENCY  (rad/ sec) 


FIGURE  3 


Effect  of  Vibration  on  Pilot  Describing  Function 
Average  of  3  Replications 


limitations.  Thus,  once  control  system  dynamics,  performance 
requirements,  and  inherent  pilot  limitations  have  been  specified, 
pilot  behavior  and  overall  system  performance  can  be  predicted. 

Readers  unfamiliar  with  this  model  are  referred  to  the 
literature  for  a  mathematical  description  of  the  model  and  for 
supporting  experimental  data  [3-5].  Because  of  the  importance 
of  pilot  remnant  in  accounting  for  the  effects  of  vibration  on 
tracking  performance,  however,  we  shall  discuss  here  our  repre¬ 
sentation  of  pilot  randomness. 

Remnant  is  modelled  partly  as  a  set  of  observation  (i.e., 
perceptual)  noise  processes  and  partly  as  a  motor  noise  process. 
Each  display  variable  used  by  the  pilot  is  assumed  to  be  per¬ 
turbed  by  a  white  noise  process  that  is  linearly  uncorrelated 
with  other  signals  circulating  through  the  tracking  system. 
Similarly,  the  pilot's  control  input  is  assumed  to  be  perturbed 
by  an  additional  independent  white  noise  process.  For  situations 
in  which  the  control  and  display  gains  are  essentially  optimized, 
the  covariances  of  these  noise  processes  scale  proportionally  with 
the  variances  of  the  signals  they  perturb.  Thus,  in  the  case  of 
a  single-variable  tracking  task,  the  noise  covariances  are  given 
as 


Vy  ’  ay  Py 


V.  ■  <j?  P» 

y  y  y 


where  the  subscripts  y,  y,  and  u  denote  tracking  error,  tracking 
error  rate,  and  control  displacement,  respectively.  (We  assume 
that  the  pilot  extracts  both  position  and  velocity  information 
from  his  display  indicator.)  The  quantities  Py,  Py,  and  Pu  are 
the  "noise/signal  ratios"  that  relate  injected  noise  covariance 
to  signal  variance.  Typical  values  for  laboratory  tracking 
tasks  are  -20  dB  for  perceptual  noise  processes  and  -25  dB  for 
motor  noise. 

Other  pilot-related  model  parameters  that  are  important  in 
representing  single-variable  tracking  behavior  are  the  effective 
time  delay  (to  account  for  transmission  and  processing  delays  of 
sensory  inputs)  and  the  "motor  time  constant"  (to  reflect  bandwidth 
limitations).  Typical  values  for  these  variables  are  0.2  seconds 
for  the  delay  and  0.1  second  for  the  time  constant. 
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Modeling  Procedures 

In  order  to  derive  a  state-variable  representation  of  the 
tracking  task,  it  was  necessary  to  represent  the  sums-of-sinusoids 
disturbance  used  in  the  experiments  by  an  equivalent  filtered  noise 
process.  Accordingly,  the  input  signal  was  aporoximated  by  a  second- 
order  Butterworth  filter  driven  by  white  noise.  A  critical  filter 
frequency  of  1.0  rad/sec  was  chosen  to  provide  an  analytical  input 
signal  of  the  same  rms  displacement  and  velocity  (and,  presumably, 
of  similar  tracking  difficulty)  as  the  experimental  input.  The 
vehicle  dynamics  were  10.5/s(s+3)  as  measured  from  the  experimental 
data.  No  attempt  was  made  to  model  the  effect  of  linear  vibration 
feedthrough  on  tracking  performance. 

The  following  modeling  strategy  was  adopted.  First,  the 
data  obtained  from  the  static  condition  were  matched  so  that  the 
full  set  of  pilot-related  model  parameters  could  be  quantified. 

Next,  data  from  the  2  Hz  vibration  condition  were  compared  with 
model  results  to  determine  which  source  of  remnant  best  accounted 
for  the  effects  of  vibration.  A  simple  relationship  between 
injected  noise  and  tracking  behavior  was  determined  from  these 
results  and  tested  by  comparing  experimental  and  model  results 
for  the  remaining  vibration  conditions. 

Additional  details  regarding  the  modeling  procedure  are 
given  in  [2]. 

Comparison  of  Experimental  and  Model  Results 

Static  Condition 

The  following  model  parameter  values  were  found  to  provide 
the  best  overall  visual  match  to  measured  frequency-domain  para¬ 
meters  and  performance  scores: 

Time  delay  ■  0.15  second 

Motor  time  constant  ■  0.095  second 

Observation  noise/signal  ratio  for  visual  variables  ■>  -20  dB 

Motor  noise/signal  rate  ■  -30  dB 

Values  for  time  delay,  motor  time  constant,  and  observation  noise/ 
signal  ratios  are  similar  to  those  that  have  been  found  in  previous 
laboratory  tracking  studies;  the  motor  noise/signal  ratio,  however, 
is  lower  than  that  generally  found  in  the  past.  The  low  motor 
noise/signal  ratio  may  have  arisen  in  part  from  the  somewhat 
different  representation  of  the  pilot-control  interface  adopted 
in  this  analysis  (see  [2] .  Also,  it  should  be  noted  that  remnant 
was  accounted  for  primarily  by  equivalent  perceptual  noise  in  the 
static  case;  consequently,  the  goodness  of  the  model  match  was 
relatively  insensitive  to  the  selection  of  a  motor  noise  level. 
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A  comparison  of  experimental  and  model  frequency-domain 
measures  is  given  in  Figure  4.  Amplitude  ratio  and  phase  shift 
are  shown  in  the  upper  two  curves;  the  lower  curve  indicates  the 
remnant  ratio  at  each  input  frequency*  Except  for  the  remnant 
ratio  at  0.5  rad/sec,  a  reasonably  good  fit  is  obtained  to  the 
experimental  measurements.  The  model  error  and  stick  SD 
scores  are  within  10%  and  20% ,  respectively,  of  the  measured 
SD  scores. 

Th t  2  Hn  Vibration  Condition 

The  2  Hz  vibration  condition  was  selected  for  exploring  the 
effects  of  vibration  on  pilot  performance  because  this  was  the 
most  severe  vibration  condition  that  provided  reliable  measure¬ 
ments  at  all  five  input  frequencies.  Since  it  was  apparent  from 
preceding  analysis  that  the  primary  effect  of  vibration  was  to 
increase  pilot  remnant,  model  parameters  related  to  perceptual 
and  motor  sources  of  remnant  were  varied  alternately  to  determine 
which  of  these  two  sets  of  variables  best  accounted  for  the 
effects  of  vibration  on  pilot/vehicle  performance. 

Two  variations  in  model  parameters  were  explored.  With  all 
remaining  model  parameters  kept  at  values  appropriate  to  the  static 
condition,  the  injected  motor  noise  was  increased  until  the  pre¬ 
dicted  error  SD  score  was  within  10%  of  the  score  obtained  experi¬ 
mentally  for  this  vibration  condition.  The  motor  noise  was  then 
reset  to  the  value  appropriate  to  the  static  condition,  and  the 
observation  noise/signal  ratios  for  error  displacement  and  rate 
perception  were  jointly  incremented  until  the  error  SD  score  was 
again  matched  to  within  10%. 

Comparisons  of  the  two  sets  of  model  results  with  experi¬ 
mental  frequency-domain  measures  are  given  in  Figures  5  and  6. 

The  motor-noise  model  appears  to  provide  a  better  match  to  the 
high-frequency  portion  of  the  pilot  describing  function  (Figure 
5),  whereas  the  observation-noise  model  provides  a  better  match  at 
low  frequencies.  If  we  consider  the  predictions  of  the  two  models 
in  the  region  of  gain  crossover,  however,  we  find  that  the  motor- 
noise  model  provides  a  superior  match.  The  gain  crossover  pre¬ 
dicted  by  this  model  configuration  is  about  2.8  rad/sec  (versus 
an  estimated  2.6  rad/sec  for  the  experimental  data),  whereas  the 
large  observation  noise  leads  to  a  gain-crossover  frequency  of 
about  2.0  rad/sec.  Thus,  the  high  motor  noise  configuration 
provides  a  better  prediction  of  the  effects  of  vibration  on 
tracking  effectiveness. 

Although  the  two  high-noise  model  configurations  appear  to 
reproduce  the  remnant-ratio  curve  equally  well  (Figure  5),  differen¬ 
ces  are  apparent  when  we  consider  individually  the  input-correlated 
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FIGURE  5.  Comparison  of  Experimental  and  Predicted  Frequency 
Domain  Measures ,  2  Hz  Vibration 
Average  of  3  Replications 
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and  remnant-related  portions  of  the  stick  spectrum  (Figure  6). 

An  appreciably  better  match  to  experimental  data  is  obtained  at 
mid  and  high  frequencies  by  the  high  motor  noise  model ,  especially 
for  the  input-correlated  spectrum.* 

In  summary ,  the  effects  of  vibration  on  tracking  performance, 
at  least  for  the  2  Hz  vibration  input,  can  be  reasonably  well 
accounted  for  by  an  increase  in  the  injected  wide-band  motor 
noise  process.  Given  the  current  formulation  of  the  model,  an 
increase  in  motor  noise  represents  both  an  increase  in  noise 
injected  into  the  system  as  well  as  degradation  in  motor-related 
perceptual  feedbacks.  Thus,  we  cannot  at  present  use  the  state- 
variable  model  to  discriminate  between  a  degradation  in  kinesthetic 
feedback  and  wide-band  driving  noise  arising  from  nonlinear  or  time- 
varying  feedthrough  of  the  vibration  input.  We  can,  nowever, 
consider  the  combined  contribution  of  motor-related  disturbances. 

Ftmaining  Vibration  Conditiont 

The  results  of  the  preceding  analysis  were  extrapolated  to 
yield  predictions  of  error  scores  and  frequency-domain  measures 
for  the  remaining  vibration  conditions.  The  injected  motor  noise 
was  assumed  to  be  proportional  to  stick  variance,**  and  a  scale 
factor  of  0.081  was  obtained  by  dividing  the  motor  noise  variance 
used  in  matching  the  2  Hz  data  by  the  stick  variance  measured  in 
that  experiment.  This  scale  factor  was  used  in  conjunction  with 
experimental  stick  variance  scores  to  compute  the  motor  noise 
levels  to  be  used  in  predicting  performance  for  the  remaining 
conditions. 

The  motivation  for  testing  a  simple  proportional  relation¬ 
ship  of  this  type  is  that  it  provides  a  parsimonious  scheme  for 
predicting  the  effects  of  vibration  on  pilot  remnant  and,  hence, 
system  performance.  Once  the  transmissibility  between  the 
vibration  source  and  the  pilot's  control  member  has  been  deter¬ 
mined,  prediction  of  pilot  remnant  is  straightforward.  The 
rationale  for  a  proportional  motor  noise  process  stems  from 
extensive  previous  experience  in  analyzing  manual  control  data. 

In  situations  where  threshold  and  saturation  effects  have  been 
unimportant,  the  various  perceptual  and  motor  noise  processes 
have  been  found  to  scale  in  proportion  to  corresponding  signal 
variances  [3-5], 

Figure  7  provides  a  comparison  of  the  measured  error 
variances  with  the  variances  predicted  by  the  model  for  the  four 


^Simultaneous  variations  of  both  motor  and  perceptual  noise 
processes  did  not  produce  a  noticeably  better  overall  match 
than  obtained  by  an  increase  in  motor  noise  alone. 

**Including  the  effects  of  vibration  feedthrough  as  well  as  the 
tracking  input. 
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ERROR  SD  SCORE  (MACHINE  UNITS) 


vibration  conditions  (including  the  matched  2  Hz  case) j  comparisons 
of  measured  and  predicted  frequency-domain  measures  may  be  found 
in  (21. 


Error  SD  scores  for  the  4.S  and  3  Hz  conditions  were  pre¬ 
dicted  to  within  201,  and  reasonably  good  predictions  were  obtained 
for  the  frequency-domain  measures.  (Qualitatively,  the  match 
between  measured  and  model  results  was  similar  to  that  shown  in 
Figure  4  for  the  static  case.)  The  error  score  for  the  1.3 
condition  was  predicted  less  accurately  (about  a  30%  error) ,  and 
the  qualitative  match  between  predicted  and  measured  frequency- 
domain  measures  was  considerably  less  good  than  that  obtained 
for  the  other  vibration  conditions.  Accordingly,  both  motor 
and  observation  noise  variables  were  re-adjusted  in  an  attempt 
to  obtain  a  better  match  to  the  1.3  Hz  data.  Although  the 
measured  error  SD  score  could  be  matched  exactly  by  increasing 
motor  and/or  perceptual  noise  levels,  correspondence  between 
model  and  measured  frequency-domain  measures  was  not  materially 
improved. 

It  should  be  noted  that  the  frequency-domain  measures  for 
the  1.3  Hz  condition  were  not  as  reliable  as  those  that  have 
been  presented  for  the  other  experimental  conditions.  Because 
of  the  large  amount  of  remnant,  reliable  measures  at  the  6.3 
rad/sec  input  frequency  could  not  be  obtained,  and  only  one  of 
the  three  replications  of  this  condition  provided  reliable 
measures  at  the  lowest  and  highest  input  frequencies.  Thus, 
the  data  available  to  this  study  were  not  sufficiently  reliable 
to  determine  whether  or  not  the  assumptions  underlying  the  pilot/ 
vehicle  model  were  violated  in  the  1.3  Hz  situations. 


SUGGESTED  MODEL  EXTENSIONS 

The  pilot/vehicle  model  used  in  this  study  can  be  combined 
with  model 8  for  mechanical  vibration  feedthrough  to  provide  a 
tentative  overall  model  for  relating  vibration  parameters  to 
pilot  and  system  perfoxmance.  This  overall  model  consists  of 
three  basic  elements:  (a)  a  model  relating  vibration  parameters 
and  various  physical  properties  of  the  pilot/vehicle  interface 
to  hand  and  eye  motions,  (b)  a  mathematical  expression  relating 
vibration-induced  motions  to  perceptual  and  motor  sources  of 
"pilot  noise",  and  (c)  a  model  for  relating  pilot  noise  and 
other  pilot-  and  system-related  considerations  to  pilot  control 
strategy  and  system  performance. 


Models  for  mechanical  feedthrough  have  been  proposed  In 
(1] t  and  continuing  studies  are  underway  to  further  validate 
and  refine  these  models.  The  state-variable  model  for  pre¬ 
dicting  the  effects  of  pilot  remnant  on  system  performance  has 
been  well-documented  in  the  literature,  as  noted  earlier.  The 
second  stage  of  the  overall  model  —  the  relation  of  vibration- 
induced  motions  to  injected  pilot  noise  —  is  new  and  is  outlined 
below. 


We  draw  upon  the  results  of  previous  analysis,  as  well  as 
the  analysis  documented  in  this  paper,  to  postulate  the  following 
tentative  model  for  the  effects  of  "ibration  on  injected  remnant. 
Each  perceptual  noise  source  is  to  be  represented  as  a  white 
noise  process  having  a  variance 

Vy  "  <Oy  +  Oq>  *  Py  <D 

2  2 
where  Oy  is  the  variance  of  the  displayed  variable,  o  is  an 

increment  to  the  variance  due  to  relative  motions  between  the 
eye  and  the  display  induced  by  vibration,  and  Py  is  the  obser¬ 
vation  noise/signal  ratio. 

A  similar  relationship  is  postulated  for  motor  noises 


V  ■  (o 
u  '°u. 


+  0.1  >  P 


u 


u 


(2) 


2 

where  out  is  the  component  of  control  variance  due  to  the  tracking 
input  and  to  pilot  remnant,  o£v  is  the  component  due  to  direct 
coupling  of  the  vibration  disturbance,  and  Pu  is  the  motor  noise/ 
signal  ratio.  The  observation  and  motor  noise/signal  ratios  are 
considered  to  reflect  central-processing  sources  of  pilot  random¬ 
ness  and,  for  the  present,  are  assumed  to  be  relatively  invariant 
with  respect  to  system  and  environmental  variables. 


The  three-stage  model  would  be  applied  in  an  iterative 
fashion.  First,  the  feedthrough  models  would  be  used  to  predict 
variances  for  relative  eye-display  motions  as  well  as  for  vibration- 
induced  control  disturbances.  These  variances  would  be  used  to 
obtain  initial  estimates  of  injected  perceptual  and  motor  noise 
levels  as  shown  in  equations  (1)  and  (2).  The  state-variable 
pilot/vehicle  model  would  then  be  applied  to  predict  system  per¬ 
formance  scores,  with  Py,  Pu,  and  other  pilot-related  model 
parameters  being  assigned  values  typical  of  those  found  in  the 
literature.  The  values  of  o3  and  ofy.  predicted  by  the  model  would 
be  used  with  the  vibration-related  variances  to  re- ad just  the 
injected  noise  variances,  and  new  model  predictions  would  be 
obtained.  This  process  would  be  repeated  until  the  relationships 
shown  in  equations  (1)  and  (2)  were  satisfied  to  within  acceptable 
tolerances. 
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The  model  expressed  by  the  relationships  of  equations 
(1)  and  (2)  is  perhaps  the  most  parsimonious  representation  of 
the  effects  of  vibration  on  remnant  that  can  be  justified  by 
existing  knowledge.  Use  of  this  model  in  the  manner  outlined 
above  allows  a  highly  simplified  treatment  of  vibration.  Consider 
some  of  the  implications t 

a.  Injected  remnant  levels  depend  only  on  total 
control  variance  and  total  effective  display 
variance.  The  spectral  shape  of  the  vibration 
signal  is  unimportant. 

b.  The  injected  noise  spectra  are  white  (i.e., 
wide-band  with  respect  to  the  signals  in  the 
tracking  loop).  Consequently,  the  shape  of 
the  closed-loop  remnant  spectrum  depends  only 
on  the  closed-loop  pilot/vehicle  dynamics 
(which  can  be  predicted  by  the  state-variable 
model)  and  not  on  the  vibration  spectrum. 

c.  Results  of  the  sinusoidal  vibration  experiments  can 
readily  be  extrapolated  to  complex  vibration  inputs. 

Obviously,  the  model  structure  suggested  here  could  be 
expected  to  apply  at  best  over  a  limited  range  of  vibration 
environments,  since  one  would  expect  assumptions  of  linearity 
to  be  invalid  in  situations  of  extreme  vibration.  Consequently, 
further  experimentation  and  analysis  is  suggested  to  determine 
the  range  of  applicability  of  the  model  and  to  identify  model 
refinements  that  might  extend  this  range. 
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ABSTRACT 


The  two  dimensional,  longitudinal  dynamics  of  an  air-to- 
air  combat  tracking  task  with  a  lead  computing  optical  sight 
system  were  simulated  on  an  analog  computer.  Three  pilots 
flew  three  different  aircraft  configurations  in  a  fixed  base 
simulator.  The  target  motion  was  simulated  by  zero  mean, 
filtered,  gaussian  noise  with  rms  amplitudes  corresponding 
to  3.5  g  and  5.0  g.  Range  to  target  was  constant  and  3000  ft 
and  1000  ft  ranges  were  simulated.  Averaged  rms  data  for 
attacker's  elevator  deflection,  pitch  rate,  lead  angle,  line 
of  sight  to  the  target,  and  tracking  error  was  taken  for  each 
case . 

A  closed  loop  model  for  the  air-to-air  combat  task  is 
developed  using  an  optimal  model  for  the  pilot.  The  optimal 
model  accounts  for  inherent  human  limitations  such  as  neuro¬ 
muscular  dynamics,  reaction  time  delay,  and  visual  acuity. 

The  pilot  model  is  optimal  in  the  sense  that  feedback  gains 
in  the  model  are  selected  to  minimize  a  quadratic  function  of 
tracking  error,  error  rate,  lead  angle  rate,  and  elevator 
deflection  rate. 

The  rms  values  of  the  attacker's  elevator  deflection, 
pitch  rate,  lead  angle,  line  of  sight  to  the  target,  and 
tracking  error  for  the  model  are  compared  to  the  simulation 
data.  The  analytic  values  of  rms  pitch  rate  tended  to  be 
slightly  higher  than  the  values  from  the  simulation;  however, 
the  trends  agree  quite  well.  The  analytic  values  of  rms 
tracking  error  are  in  general  agreement  with  the  simulation 
results  and  in  every  case  the  difference  between  the  analytic 
value  and  simulation  value  is  less  than  the  visual  threshold 
of  the  pilot.  The  analytic  values  of  rms  elevator  deflection, 
lead  angle,  and  line  of  sight  agree  quite  precisely  with  the 
measured  values.  It  is  concluded  that  the  model  can  be  used 
to  predict  p- lot-vehicle  performance  in  the  air-to-air  combat 
task  simulated. 


♦Currently  assigned  to  the  Air  Force  Systems  Command,  Satellite 
Control  Facility,  Sunnyvale,  California. 


INTRODUCTION 


The  task  of  accurately  tracking  a  maneuvering  target  for 
the  purpose  of  obtaining  a  kill  with  airborne  cannon  fire  is 
one  of  the  most  difficult  required  of  a  fighter  pilot.  As  is 
the  case  when  firing  any  projectile  at  a  moving  target,  lead 
for  target  motion  must  be  computed  and  the  aiming  direction 
adjusted  to  compensate  accordingly.  Further  complicating  the 
air-to-air  problem,  trajectory  adjustments  must  be  made  to 
account  for  projectile  drag,  velocity  jump,  and  gravity  drop, 
as  well  as  other  more  minor  effects.  In  most  modern  fighter 
aircraft,  the  required  lead  compensation  is  continuously 
computed  using  air  data  information  and  displayed  on  a  heads 
up  display.  The  lead  information  is  normally  presented  to 
the  pilot  of  the  ttacking  aircraft  in  the  form  of  a  pipper 
that  is  two  mils  in  diameter  and  is  surrounded  by  a  larger 
circle  called  the  reticle.  The  pipper  is  depressed  from  the 
weapon  line  by  the  amount  of  the  computed  lead  angle  as  shown 
in  Fig.  1.  When  the  pilot  maneuvers  his  aircraft  in  such  a 
manner  as  to  place  the  pipper  on  the  target,  he  has  achieved 
the  proper  aiming  direction  to  insure  a  kill  provided  the 
target  maneuver  remains  constant.  A  sight  of  this  type  is 
called  a  lead  computing  optical  sight  (LCOS) . 


Fig.  1.  Air-To-Air  Tracking  as  Seen  by  Pursuing 
Pilot  at  Close  Range  (Approximately  1000  Feet). 
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Two  practical  problems  are  encountered  with  the  sight 
design.  First,  the  lead  computation  is  an  approximation  and 
there  is  usually  a  trade  off  between  the  accuracy  of  the 
computed  lead  and  t.he  time  lag  introduced  by  the  computation 
time.  Secondly,  the  continuous  lead  computation  creates  sight 
dynamics  or  motio.  of  the  pipper  that  may  be  confusing  or 
unsuitable  to  the  pilot.  For  example  if  the  sight  dynamics 
are  lightly  damped,  the  pilot  may  have  to  exercise  special 
care  to  avoid  pilot  induced  oscillations  (PIO).  The  overall 
effect  of  adverse  sight  dynamics  can  be  a  reduction  in  the 
aiming  accuracy  despite  the  fact  that  the  lead  computation  is 
reasonably  accurate. 

It  would  be  extremely  desirable  to  have  a  reliable  method 
for  analytically  predicting  piloted  performance  in  an  air-to- 
air  combat  situation.  In  this  way,  the  trade  offs  involved 
in  computing  lead  could  be  evaluated  using  the  closed  loop 
dynamics  of  the  pilot-vehicle  system.  The  sight  parameters 
could  be  optimized  and  the  suitability  of  the  sight  dynamics 
in  the  closed  loop  tracking  task  could  be  evaluated.  Further¬ 
more,  this  could  be  done  without  resorting  to  extensive  simu¬ 
lation  or  flight  tests. 

A  simplified  model  for  the  closed  loop  air-to-air  combat 
task  has  been  developed  and  validated  by  experimental  data. 
This  work  is  described  in  this  paper.  First  the  piloted 
simulation  study  that  was  used  to  collect  data  for  an  air-to- 
air  combat  task  is  described.  The  equations  are  given  and  the 
assumptions  delineated.  A  control  theoretic  optimal  pilot 
model  is  used  to  develop  an  analytic  model  for  the  task. 

This  model  is  briefly  described  and  the  representation  of 
human  limitations  used  in  the  model  are  given.  A  comparison 
of  the  experimental  and  analytic  results  are  given  as  a 
demonstration  of  the  model's  validity. 

SIMULATION 

The  two  dimensional,  longitudinal  dynamics  of  an  air-to- 
air  combat  tracking  task  with  a  lead  computing  optical  sight 
were  simulated.  The  in  plane  geometry  for  the  air-to-air 
tracking  situation  is  shown  in  Fig.  2.  The  following  notation 
is  used  in  Fig.  2: 

VA  -  velocity  of  attacker  (ft/sec) 

V^.  -  velocity  of  target  (ft/sec) 

-  attacker  flight  path  angle  (radians) 

y  -  target  flight  path  angle  (radians) 

a  -  attacker  angle  of  attack  (radians) 

9  -  attacker  pitch  angle  (radians) 
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Z„  -  relative  line  of  sight  angle  (radians) 

TA 

X  -  lead  angle  (radians) 
e  -  error  (radians) 

Z^  -  inertial  line  of  sight  angle  (radians) 

Attacking  Aircraft  Equations 

The  equations  of  motion  of  the  attacking  aircraft  are 
approximated  by  the  linearized  longitudinal  short  period 
equations  of  motion.  These  are 

•  _ 

a  «  q  ♦  Z  a  ♦  Z.6 
a  o 

q«Mq*Ma  +  M*a*M,6 
n  qn  a  a  6 


where 

q  -  pitch  rate  (radians/sec) 

6  -  elevator  deflection  (radians) 

The  constants  Z  ,  Z.,  M„ ,  etc.,  are  stability  derivatives 
a  6  q 

associated  with  a  given  aircraft  and  flight  condition. 

Elevator  actuator  dynamics  are  modeled  by  a  first  order 

lag. 

6  *  -206  ♦  20K.6 
L  C 

where  6£  is  commanded  elevator  position  and  is  the  control 

linkage  gain.  A  force  stick  was  used  in  the  simulation  and 

-6  ■  K.F  where  F  is  force  applied  by  the  pilot  and  Kf  is 

C  I  s  s 

the  force  stick  sensitivity.  was  adjusted  to  insure  the 

pilot  had  as  much  control  authority  as  he  wanted. 

Target  Equations 

The  target  was  assumed  to  be  a  fighter  aircraft  and  the 
target's  normal  acceleration,  An^,  was  modeled  by  driving  a 

second  order  filter  with  zero  mean,  gaussian  white  noise. 

The  equations  are 


The  dummy  variable  y  is  used  to  put  the  equations  in  first 
order  form  and  £  is  the  white  noise  input.  The  -.Oly^  term 

in  the  target  flight  path  differential  equation  is  an  artificial 

feedback  used  to  keep  the  steady  state  variance  of  y^  finite. 

A  value  of  T.J,  *  3  sec  was  used  because  it  resulted  in  a  target 

motion  that  looked  good. 

The  inertial  line  of  sight  from  the  attacker  to  the 
target  is  given  by  (Ref  1) 

r_  ■  [sxV_  -  sxV.) 

T  D  T  AJ 

where  s  is  a  unit  vector  along  the  line  of  sight  and  D  is  the 
distance  between  the  attacker  and  the  target.  Assuming  motion 
only  in  the  plane, 

V  V 

Ex  »  -I  sin  (Y--Z  )  - -  sin  (6-1  -a) 

1  D  1  T  D  1 

Assuming  that  the  velocity  vectors  of  the  attacker  and  the 
target  are  closely  aligned  with  the  line  of  sight,  small  angle 
approximations  can  be  used  to  arrive  at 

VA  VVT  VT  VA 

ZT  -  —  a  ♦  ~ — I  Z T  ♦  —  y T  -  —  9 

D  ODD 


In  the  simulation,  the  closing  velocity,  VA_VT*  w»s  taken  to 

be  zero  and  D  was  assumed  to  be  constant.  This  restriction 
was  made  so  that  the  simulation  equations  would  not  be  time 
varying . 


Sight  Equations 


The  sight  equation  is  taken  from  Ref  1  and  a  more  detailed 
derivation  is  contained  in  Ref  2.  The  differential  equation 
for  lead  that  was  used  is 


X 


-  ±-  X  ♦ 


VA 


a 


where 


T^  -  time  of  flight  of  projectile  (sec) 

-  muzzle  velocity  of  projectile  (ft/sec) 


J 


V 


velocity  jump  correction  angle  (radians) 


The  velocity  jump  correction  angle  is  used  to  compensate  for 
the  misalignment  of  the  velocity  vector  of  the  attacker  and 
the  projectile  muzzle  velocity  vector.  The  lead  correction 
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for  gravity  drop  is  a  function  of  roll  angle.  Based  on  the 
assumption  that  the  plane  of  flight  is  not  rotating,  the 
gravity  drop  term  will  only  introduce  a  fixed  bias  in  the 
equations  and  not  affect  the  rms  values  of  the  states.  For 
this  reason  it  was  not  considered  in  the  simulation. 


A  dual  beam  oscilloscope  was  used  to  display  the  target 
and  the  sight.  The  display  is  shown  in  Fig.  3.  The  center  of 
the  oscilloscope  was  taken  to  be  the  extension  of  the  aircrafts 
weapon  line.  The  target  was  an  inverted  T  positioned  relative 
to  the  weapon  line  by  The  sight  is  positioned  relative 

to  the  weapon  line  by  A.  Only  the  reticle  portion  of  sight 
was  displayed  due  to  the  limitations  of  the  oscilloscope. 

In  order  to  accomodate  the  large  lead  angles,  the  display  was 
scaled  for  13*  per  cm.  The  scope  was  positioned  20  inches  in 
front  of  the  pilot. 

Cases  Simulated 

Twelve  cases  were  considered  by  considering  all  combina¬ 
tions  of  three  aircraft  dynamics,  two  ranges,  and  two  rms 
normal  accelerations  for  the  target. 


The  three  aircraft  considered  were  F-4E,  F-5,  and  A-7. 
The  aircraft  and  corresponding  flight  conditions  were  picked 
to  give  a  range  of  aircraft  dynamics  from  good  to  bad  for  the 
air-to-air  combat  tracking  task. 

The  two  ranges  simulated  were  1000  ft  and  3000  ft.  In 
retrospect,  the  3000  ft  range  was  not  very  realistic  as  a 
firing  range.  However,  the  choice  was  fortunate  in  that  the 
sight  dynamics  for  that  range  were  highly  oscillatory  and  the 
results  were  useful  in  developing  the  analytic  model. 

The  two  rms  acceleration  levels  for  the  target  were 
3 . Sg ' s  and  5.0  g  ' s  . 

Test  Conduct 


Three  military  pilots  were  used  in  the  simulation.  All 
three  pilots  had  air-to-air  combat  experience.  Each  pilot 
was  thoroughly  trained  on  each  of  the  twelve  cases  prior  to 
taking  data.  Each  pilot  made  three  data  runs  for  each  case. 
Different  target  time  histories  were  used  to  keep  the  pilot 
from  learning  the  target  motion.  The  simulation  was  conducted 
so  that  data  was  taken  only  during  steady  state  tracking  over 
a  100  second  interval.  The  mean  and  the  variance  of  the 
following  variables  were  determined:  elevator  deflection, 
pitch  rate,  lead  angle,  relative  line  of  sight  to  the  target, 
and  tracking  error. 


PILOT  MODEL 

An  analytic  model  was  developed  for  the  closed  loop  air- 
to-air  combat  tracking  task  that  was  simulated.  The  pilot 
was  modeled  by  an  optimal  pilot  model,  the  form  of  which  was 
developed  by  Kelinman,  Baron,  and  Levison  (Ref  3).  This  model 
has  been  successfully  applied  to  a  number  of  other  tasks 
including  VTOL  hover,  landing  approach,  and  anti-aircraft 
gun  tracking  (Refs  3  through  7).  A  block  diagram  of  the 
optimal  pilot  model  is  shown  in  Fig.  4.  The  displayed  vari¬ 
ables,  y,  are  observed  by  the  pilot.  Visual  errors  are 
accounted  for  by  additive  gaussian  white  noice,  vy .  The 

noisy  observation  is  delayed  by  time  x,  which  represents  a 
perceptual  time  delay.  The  best  estimate  of  the  current  state 

A 

x,  is  reconstructed  using  an  optimal  estimator  and  predictor. 
The  control  is  generated  by  multiplying  the  optimal  estimate 
.tf  the  state  by  a  set  of  optimal  feedback  gains.  The  feedback 
gains  are  optimal  for  the  cost  function 

J(6  )  -  lim  E { [Me (T) ] 2  ♦  [M-e(T)]2  +  [M  •  A (T) ] 2  ♦  [M:  6  (T)  ]  2 } 
c  e  e  A  6  c  e 

Gaussian  white  noise,  vn,  is  added  to  the  control  output,  6'. 
This  noise  accounts  for  neuromuscular  noise  and  control  errors 
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Figure  4.  Functional  Schematic  of  the  Optimal  Pilot  Model  in  the  Control  Loop, 


The  pilot  output,  6^,  is  obtained  by  passing  6«-vn  through 
a  first  order  lag  with  time  constant  tn<  Mathematical ly,  the 

lag  is  a  part  of  the  optiaal  solution  for  the  cost  function 

J($  )  since  it  includes  a  weighting  on  control  rate, 
c  c 

Physically,  can  be  considered  as  a  model  of  the  lag  in  the 

neuromuscular  system.  The  parameters  that  are  used  to  define 

the  specific  model  are  described  next. 


Cost  Functional  Weightings 


The  weightings  in  the  cost  function  are  defined  by  the 
ilot's  objective  and  subjective  measures  of  goodness  for  the 
task.  The  primary  objective  in  the  air-to-air  combat  task 
is  to  minimize  the  error.  The  *>ilot  will  also  avoid  excessive 
error  rate  since  it  induces  u  .  ~irable  oscillations  in  the 
error.  The  first  WAG  that  was  tried  was  M£  ■  M£,  ■  0. 

This  worked  well  for  the  1000  ft  cases,  but  the  analytic  values 
of  rms  error  for  the  3000  ft  cases  were  way  too  low.  The 
pilots  were  asked  what  they  did  different  at  3000  ft  than  at 
1000  ft.  It  turned  out  that  the  sight  was  extremely  oscillatory 
at  the  3000  ft  range  and  the  pilots  had  to  be  very  careful  not 
to  cause  the  sight  to  oscillate.  This  subjective  consideration 
is  treated  by  weighting  lead  rate.  The  values  used  are  related 
by 


M-  «  i  M, 
c  4  e 

M:  ■  -  M 

X  2  c 


The  value  of  Me  is  arbitrary. 


The  weighting  on  control  rate,  M.  ,  is  set  to  a  value  that 

6  C 

yields  tn  ■  .1  sec.  This  value  of  tn  is  consistent  with  prior 
applications  of  the  optimal  pilot  model  (Refs  3  through  7). 


Observation  Noise 


Error  and  lead  are  observed  by  the  pilot.  In  accordance 
with  the  model  ground  rules,  it  is  assumed  that  the  first 
derivative  of  the  displayed  variable  are  perceived  by  the 
pilot  (Ref  3).  Thus  the  output  vector  is 


y1  •  c 
y2  -  e 
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Denoting 


E{vyiCt)vyi(s) ’>  "  Vyi5(t"s^ »ial » •  •  •  »4 


the  observation  noise  is  scaled  to  the  ras  magnitude  of  the 
observation  by 

.2 


V  .  ■  up  o' 
yi  Mv  yi 


A  value  of  Pv  ■  .01  was  used  and  is  consistent  with  the  value 


used  in  Refs  3  through  7.  (This  corresponds  to  a  -20dB  white 
noise  power  spectral  density  level.) 


Threshold  Effects 


Threshold  effects  associated  with  visual  acuity  and  the 
ability  to  percieve  notion  were  considered  in  the  nodel. 

These  effects  turn  out  to  be  significant  for  this  simulation 
because  of  the  way  the  display  was  scaled.  To  account  for  the 


visual  thresholds,  the  percieved  output,  •  1*  expressed  as 


ypi(t)  *  fi^yi(t)J  *  vyi(t) 


where 


f^y) 


y  i  a, 


<  y  S  a. 


<  -a. 


y+aj,  y  i  -aj 

and  a.  is  the  threshold  level.  Describing  function  theory 


(Ref  8)  is  used  to  determine  a  scale  factor  as  a  function 
of  aA  so  that  the  effect  of  the  nonlinearity  can  be  approxi¬ 
mated  by  an  increase  in  the  observation  noise  as  follows: 


Vl) 


yjU) 


*  k ivy i (t) 


A  typical  value  for  the  human  threshold  for  position  is  .05* 
of  visual  arc  (Refs  5  and  7).  For  the  position  of  the  pilot 
and  the  display  scale  factor  in  the  simulation,  this  gives 
theshold  levels  of 


.65* 


A  threshold  for  human  rate  perception  of  .05-.  1*  visual 
arc/sec  is  suggested  in  Ref  5;  however,  no  specific  value  was 
used.  In  Ref  7,  a  value  of  .18°  visual  arc/sec  was  used. 

In  this  study  a  value  of  .15*  visual  arc/sec  for  the  rate 
threshold  was  used.  It  was  found  that  lower  values  did  not 
result  in  as  good  agreement  between  the  simulated  and  analytic 
values  of  rms  error.  The  value  of  .15°  visual  arc/sec  results 
in  rate  thresholds  of 


Time  Delay 


a*  ■  a:  ■  1.9S*/sec 

G  A 


The  pilot  time  delay  was  taken  to  be  T  ■  .2  sec.  This 
value  is  consistent  with  Refs  3  through  7. 

Neuromuscular  Noise 


Denoting 


E(vu(t)vu(s)}  -  Vu6(t-s) 

The  neuromuscular  noise  is  scaled  to  the  rms  magnitude  of  the 
pilot  output  by 


Values  for  py  of  from  .003  to  .01  are  suggested  in  Refs  3 
through  7.  it  was  found  that  better  agreement  between  the 
simulation  and  analytic  rms  values  of  error  was  obtained  with 
p  »  .002.  This  corresponds  to  a  white  noise  power  density 

level  of  -27dB.  There  are  two  possible  reasons  that  the 
neuromuscular  noise  had  to  be  relatively  small  !n  the  pilot 
model.  First,  a  force  stick  was  used  in  the  simulation. 

The  force  stick  is  a  very  linear  transducer  and  any  errors 
due  to  stick  nonlinearities  are  virtually  eliminated. 
Secondly,  the  pilots  selected  stick  sensitivites  that  were 
optimal  and  control  errors  should  therefore  be  minimized. 

RESULTS 


The  rms  values  of  the  attacker's  elevator  deflection, 
pitch  rate,  lead  angle,  line  of  sight  to  the  target,  and 
tracking  error  for  the  model  are  compared  to  the  simulation 
data  in  Figs.  5  through  9.  The  comparisons  are  made  via 
scatter  diagrams.  It  can  be  seen  from  Fig.  6  that  the  analytic 
values  of  rms  pitch  rate  are  slightly  higher  than  the  simulation 
values.  The  trend  is  excellent,  however.  The  analytic  values 
of  rms  tracking  error  are  in  general  agreement  with  the  simula¬ 
tion  results  (Fig.  9).  It  may  be  noted  that  in  every  case, 
the  difference  between  the  analytic  values  and  simulation 
values  of  rms  error  is  less  than  the  error  threshold  value 
of  .65  degrees.  The  agreement  between  analytic  values  and 
simulation  values  of  rms  elevatir  deflection,  lead  angle,  and 
line  of  sight  is  excellent. 
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1st  #  =  Range  (Feet  x  1000) 
2nd  #  =  Target  Acceleration 
(3  »  3.5G|  5  =  5.0G) 


Actual  rns  Elevator 
Deflection  (degrees) 

Fig.  5.  Comparison  of  Actual  and  Analytic 
Value*  of  rms  Attacker's  Elevator  Deflection 
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o  =  F-4E 
□  =  F-5 
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(1st  #  =  Range  (Feet  x  1000) 
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.  (3  =  3.50t  5  =  5.0G) 


lUUSil 


it:::::::::::::::::: 


Actual  rms  Pitch  Rate 
(degrees/sec) 


Fig.  6.  Comparison  of  Actual  and  Analytic 
Values  of  rms  Pitch  Rate.  a. 
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Fig.  8.  Comparison  of  Actual  and  Analytic 
Values  of  rms  Line  of  Sight,  ZTA . 
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Fig.  9.  Comparison  of  Actual  and  Analytic 
Values  of  rms  Error,  £. 


CONCLUSIONS 

The  major  conclusion  is  that  the  model  workedl  The  model 
provided  a  faithful  reproduction  of  those  results  that  were 
measured  in  the  simulation.  The  model  was  reasonably  simple 
to  develop.  The  analytic  values  of  rms  error  and  pitch  rate 
are  senstivie  to  the  choice  of  weightings  on  state  in  the 
cost  function,  i.e.,  M  ,  M* ,  and  M* .  The  values  used  were 

£  £  A 

established  after  three  trials  and  were  picked  so  the  data 
matched.  It  may  have  been  possible  to  pick  the  values  a  priori 
by  judicious  questioning  of  the  pilots.  The  rms  value  of 
error  was  also  sensitive  to  the  neuromuscular  noise  level. 

The  lower  value  of  py ,  corresponding  to  -27dB  white  noise 

power  density  level  for  the  neuromuscular  noise,  is  probably 
reasonable  for  an  ideal  linear  control  input  device.  A  value 
of  -25dB  was  used  in  Ref  6  and  the  control  device  was  nonlinear 
All  other  parameters  used  in  the  pilot  model  were  basically 
taken  from  previous  applications  of  the  optimal  pilot  model. 

it  is  not  definite  at  this  point  if  the  simulation 
described,  and  hence  the  analytic  model,  is  a  suitable  represen 
tation  of  the  actual  air-to-air  combat  tracking  task.  The 
pilots  indicated  that  the  dynamics  in  the  simulation  were 
representative  of  actual  aircraft  and  sight  dynamics.  However, 


there  are  soi»e  way  out  assumptions  (linear  equations,  time 
invariance,  in  plane  motions,  etc.)  which  can  not  be  justified 
in  an  off  handed  manner.  The  next  order  of  business  is  to 
determine  if  the  simple  model  described  in  this  paper  can  be 
used  to  predict  performance  in  the  actual  air-to-air  combat 
tracking  task.  If  not,  the  model  can  be  extended  to  include 
lateral  dynamics  and  three  dimensional  kinematics.  If  it  is 
necessary  the  time  varying  dynamics  can  be  included  in  the 
model  as  in  Ref  7  and  even  nonlinearities  can  be  accounted 
for  in  the  model  as  in  Ref  6. 
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Abstract 

Potentially  more  complex  and  demanding  maneuvers  during  instrument 
landing  approaches  may  be  fostered  by  microwave  landing  guidance  systems  of  the 
future.  A  flight  control  system  is  designed  for  a  STOL  aircraft  (Breguet  941) 
which  would  allow  a  pilot  to  follow  curved  approach  paths  while  subjected  to 
turbulence  and  initial  approach  position  errors.  The  performance  index  is  the 
expected  value  of  a  weighted  integral  quadratic  sum  of  state  and  control 
variables. 

The  pilot-in-the-loop  design  results  in  a  closed-loop  system  which  sends 
an  optimal  sum  of  aircraft  and  pilot  states  to  the  display  command.  It  takes 
into  account  pilot  response  limitations  and  makes  use  of  pilot  model  parameter 
values  known  to  evoke  good  pilot  ratings. 

The  system  model  includes  aircraft,  pilot,  and  control  dynamic  models, 
as  well  as  gust  disturbance  and  measurement  noise  models.  Noise  is  also 
inserted  to  account  for  the  pilot's  multi-axis  workload. 

Limited  state  feedback  theory  is  used  to  produce  a  control  structure  which 
does  not  include  certain  prespecified  state  variables.  A  unique  algorithm  for 
calculating  the  limited  state  feedback  gain  matrix  is  developed. 

Frequency  response  techniques  are  used  to  test  the  designed  system  for 
evaluation  of  handling  qualities.  A  nonlinear  digital  simulation  is  performed 
to  test  the  total  system  design.  Results  acceptable  for  Category  II-B  landing 
approach  were  obtained. 

This  paper  is  a  condensed  version  of  work  reported  in  greater  detail  in 
Reference  17. 


INTRODUCTION 


Congestion  in  the  airport  terminal  area  has  resulted  in  much  research 
related  to  improving  approach  accuracy  and  increasing  aircraft  landing  rates. 
One  new  landing  aid  is  the  scanning  beam  microwave  instrument  landing  system 
(MLS)  [1,2]  which  will  replace  the  current  ILS.  The  MLS  has  a  number  of 
interesting  properties  which  have  fostered  research  into  ways  of  employing 
the  system  to  its  utmost  capabilities.  The  scanning  property  enables  design 
of  curved  and  broken  trajectories  which  add  new  possibilities  for  separation 
investigations  and  noise  abatement  approaches. 

Curved  trajectories  are  particularly  interesting  as  they  afford  an 
extra  separation  dimension,  i.e.,  lateral  spacing  for  different  speed  classes 
[3].  This  situation  has  been  Investigated  [4]  as  a  minimum  time  to  landing  for 
a  two  and  a  three  aircraft  optimization  problem. 

Given  a  specified  trajectory,  the  problem  becomes  one  of  following  the 
approach  track.  An  aircraft  is  faced  with  numerous  inputs  which  tend  to  force 
it  off  the  desired  path.  These  are  steady  winds  and  shears,  wind  gusts, 
collision  avoidance  possibilities,  piloting  technique,  and  errors  in  measure¬ 
ments.  In  addition,  the  assurance  of  a  fast  tract  capture  for  initial  position 
and  attitude  errors  is  an  important  consideration. 

Cherry,  et.  al.,  [23]  Investigated  attitude  commands  to  compensate  for 
steady  winds.  Although  there  are  numerous  published  works  on  collision 
avoidance,  the  task  of  collision  prevention  or  strategic  avoidance  is  best 
served  by  Insuring  the  most  accurate  path  following  in  the  face  of  the  other 
inputs. 

Trajectory  path  following  requires  a  closed-loop  design  which  commands 
reasonable  control  effort  and  produces  minimum  path  deviation.  The  design 
must  yield  acceptable  pilot  responses  and  opinions,  while  retaining  passenger 
comfort.  The  problem  can  be  viewed  as  a  feedback  regulator  design.  There 
are  two  types  of  regulator  problems:  one  is  recovery  from  initial  track 
errors,  and  the  other  is  regulation  in  the  face  of  stochastic  Inputs.  It  can 
be  assumed,  however,  that  initial  errors  can  be  sufficiently  eliminated 
sometime  soon  after  beam  capture  just  by  designing  a  reasonably  stable  system. 
The  assumption  is  that  the  closer  one  gets  to  the  critical  part  of  the  path 
sequence,  i.e.,  closer  to  the  ground,  the  less  likely  that  an  initial  path 
error  will  still  aggravate  the  situation.  The  stochastic  Inputs,  such  as  wind 
gust  and  measurement  noise  being  constantly  applied  throughout  the  trajectory, 
provide  a  much  greater  design  challenge  for  regulation. 

The  design  criterion  of  a  control  system  of  this  type  is  appropriate 
path  error  achievement  in  relation  to  the  FAA  Category  II  window.  Pilot 
acceptance,  in  terns  of  a  good  pilot  rating,  is  also  important.  The  first 
criterion  will  be  investigated  by  examining  the  three-sigma  standard  deviation 
position  response,  i.e.,  99.74%  probability  of  never  exceeding.  The  pilot 
acceptance  requirement  will  be  checked  by  comparing  the  designed  systems 
parameters  with  those  associated  with  a  given  pilot  rating  [5].  One  can  also 
get  a  qualitative  feel  for  passenger  comfort  by  examining  the  aircraft  attitude 
responses. 
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Another  Important  aspect  of  the  problem  Is  the  dynamic  coupling  of  the 
longitudinal  and  lateral  modes  of  flight  during  high  bank  maneuvers.  Conven¬ 
tional  control  design  techniques  make  use  of  the  convenient  de-coupling  of 
the  plant  dynamics  under  zero  bank  flight.  For  the  new  curved  trajectories 
one  must  account  for  the  steady  state  bank  commands  given,  if  not  by  appro¬ 
priate  compensation,  then  by  verification  of  designed  feedback  gains,  i.e., 
those  designed  with  uncoupled  dynamics. 


PROBLEM  FORMULATION 

Since  visual  displays  can  prescribe  the  control  commands  for  a  pilot  to 
operate  on,  the  idea  of  using  a  pilot  model  in  the  synthesis  process,  rather 
than  just  the  evaluation  process,  gains  validity.  Conventional  displays, 
i.e.,  using  predetermined  display  variables,  have  been  designed  in  this  fashion 
[6,7].  The  pilot  model  used  most  often  is  the  McRuer  Crossover  model.  It  has 
been  discovered  that,  like  the  consistency  of  plant  model  parameter  variation 
versus  pilot  rating,  there  is  a  correlation  between  pilot  rating  and  pilot 
model  parameters  [8,9,10,11]. 

The  objective  of  this  work  is  to  determine  a  display  variable  set  which 
best  achieves  the  design  goals  stated  earlier.  These  display  variables  would 
be  presented  as  control  commands  on  a  display  screen,  but  no  attempt  is  made 
in  the  present  work  to  specify  how  these  commands  are  presented.  William 
Seitz  [12]  did  much  work  on  this  aspect  of  the  problem  through  the  comparison 
of  the  flight  director  mode  versus  a  control  director  design. 

Also  assumed  at  the  outset  is  that  each  display  command  will  not  be  a 
function  of  just  one  variable,  e.g.,  pitch  error  to  command  the  elevator,  but 
the  commands  will  be  a  linear  function  of  many  states,  e.g.,  position,  velocity 
pitch  angle,  pitch  rate,  etc.  entering  into  the  elevator  command.  This  idea 
is  called  a  quickening  display  and  was  originated  by  Muckier  and  Obermayer 
[11].  Seitz  employed  this  idea  in  designing  a  display  setup.  He  used  optimal 
feedback  to  specify  the  quantity  of  each  state  used  in  a  control  command.  The 
optimal  control  idea  spurred  this  current  effort. 

The  use  of  optimal  control  theory  requires  that  the  number  of  measurements 
or  unique  combinations  of  states  equals  the  order  of  the  controllable  system. 
There  is,  however,  theory  [13,14]  developed  allowing  the  designer  to  choose  a 
smaller  set  of  output  variables  for  feedback  which  allows  one  to  eliminate 
states  which  are  Inconvenient  to  measure.  Perhaps  more  importantly,  limited 
state  feedback  allows  insertion  of  the  pilot  into  the  overall  design  plant 
without  requiring  that  his  state  variables  be  measured  for  use  in  the  control 
commands . 

Because  the  output  signals  are  optimally  combined  for  display,  the 
position  of  the  pilot  in  the  feedback  loop  is  between  the  aircraft  dynamic 
plant  and  the  feedback  control  gain  matrix  as  shown  in  Figure  1.  The  appear¬ 
ance  of  a  remnant  term,  exponentially  correlated  noise,  accounts  for  the  pilot' 
additional  workload,  i.e.,  multiaxis  task  with  instrument  scanning. 
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It  has  been  shown  that  for  a  human  tracking  task,  the  pilot  response  is 
rated  proportionally  to  his  perception  of  how  well  he  is  doing  [9].  The  idea, 
however,  is  implicit  in  that  once  designed  it  is  hoped  that  the  real  pilot  will 
perform  similar  to  the  design  model  and  give  the  rating  commensurate  with 
these  dynamics.  The  design  verification  used  is  an  examination  of  the  open- 
loop  frequency  response  of  the  aircraft  and  pilot  using  the  designed  control 
commands.  This  is  done  because  the  open-loop  system  response  indicates  possible 
pilot  rating  trends  [8,5]. 

The  aircraft  which  served  as  the  design  vehicle  was  the  Breguet  941  STOL 
airplane.  The  possibility  of  a  high  approach  flight  path  angle  and  slow 
speed  provides  one  with  a  good  challenge  for  stochastic  regulation. 


MODEL  DEVELOPMENT 


The  use  of  optimal  quadratic  control  theory  allows  the  designer  to 
specify  the  goals  of  the  tracking  mission  in  the  performance  index.  The  one 
used  here  is 


J 


E{Lim  r- 
t£»  Cf 


|  f  [xT(t)Qx(t)  +  uT(t)Ru(t) ]dt} 
0 


(1) 


where  x(t)  is  the  n  dimensional  state  vector  subject  to  the  differential 
constraint 


x(t)  »  Ax(t)  +  Bu(t)  +  Gq  (2) 

u(t)  is  the  control  vector,  n  is  a  random  input  noise  (gaussian-white)  vector, 
matrices  A,  B,  and  G  contain  the  plant  parameters  and  may  be  functions  of 

physical  situations  can  be  included  in  the  plant  matrices  A,  B  and 
system  to  be  controlled  can  also  contain  many  subsystems.  The  plant 
problem  ±s  composed  for  four  subsystems:  the  aircraft  and  control 
dynamics,  pilot  dynamic  model,  gust  dynamic  model,  and  models  of  measurement 
noise  and  filter  dynamics. 

The  aircraft  vector  has  twelve  states  for  this  work.  This  is  the 
continuous  perturbation  approach  which  represents  both  the  translational  and 
rotational  dynamics  of  the  aircraft.  In  state-matrix  form  this  is 


Ax  +  Bx  +  Gx 
a  a  a  c  a  g 


(3) 


x  is  the  control  input  state  vector,  x  is  the  gust  input  vector,  and  xfl  is 
tfie  aircraft  state  vector. 
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X 

a 


x,  position  perturbation  in  forward  direction 

y,  position  perturbation  in  lateral  direction 

z,  position  perturbation  in  vertical  direction 

x,  velocity  perturbation  in  forward  direction 

y,  velocity  perturbation  in  lateral  direction 

z,  velocity  perturbation  in  vertical  direction 

p,  perturbated  roll  rate 

q,  perturbated  pitch  rate 

r,  perturbated  yaw  rate 
<j>,  perturbated  roll  angle 
6,  perturbated  pitch  angle 
ip,  perturbated  yaw  angle 


(4) 


Although  this  dynamic  description  is  not  an  explicit  function  of  time, 
the  theory  allows  changes  in  steady-state  roll  angle  $  and  yaw  rate  as  they 
are  assumed  to  be  functions  of  time.  This  will  be  imp8rtant  for  investigations 
of  curved  approaches.  A  detailed  description  of  this  plant  for  the  Breguet 
aircraft  is  given  elsewheie  [17]. 


The  pilot  model  used  is  both  simple  and  demanding.  A  survey  of  past.  :T’d 
current  literature  [8,9,10,15,5]  reveals  that  a  pilot  will  behave  in  a 
predictable  manner  under  certain  conditions.  Given  a  continuous  control  task 
requiring  human  responses  within  predetermined  physical  limitations,  a  pilot 
will  perform  in  a  single  axis  according  to  the  following  transfer  function  [9] : 


P.T.F. 


W+1)  -V 

(TjB+1)  E 


(5) 


To  use  this  transfer  function  in  the  linear  system  form  proposed,  one 
must  approximate  the  pure  delay  term  with  the  Padd  [16]  first  order  form. 


(f  -  8) 

N 

(f  +  s) 


(6) 


The  Tp  term  is  a  lead  corresponding  to  the  pilot's  anticipation  of 
commands  and  is  set  to  zero  in  the  design  as  lead  tends  to  degrade  the  pilot 
rating.  A  value  of  T^  -  0.3  sec  allows  ample  margin  for  cerebral  computation 
and  muscular  reaction  time,  while  a  value  of  T^  ■  0.1  sec  allows  for  a  little 
"laziness"  in  control  movements. 

The  gain  K  is  adjusted  by  the  pilot  to  set  the  control  task  frequency 
demands  into  a  Hesirable  range  for  his  manipulation.  This  parameter  varies 
somewhat  with  the  individual  pilot  and  can  be  adjusted  independently  of  the 
design  phase  for  best  ratings.  A  unit  value  will  be  used  here. 
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PutCing  this  into  state-matrix  form  yields  the  following  vector-matrix 
differential  equation: 


A  .x  .  +  B  .u 
pi  pi  pi 


(7) 


where 


p^ei>  pilot  stick  deflection  to  elevator 
^6e2'  seconc*  PllQt  elevator  deflection  state 
p^ai*  pilot  stick  deflection  to  aileron 
p^a2»  second  pilot  aileron  deflection  state 
p^ri*  pilot  control  deflection  to  rudder 
p^r2»  second  pilot  rudder  deflection  state 


Since  the  pilot  is  asked  to  perform  a  tracking  task  in  three  axes,  the 
pilot  model  must  somehow  account  for  this  Increased  workload  and  the  coupling 
of  the  tasks.  Significant  work  in  this  area,  [9,10,6],  has  been  done,  and  it 
has  been  demonstrated  that  one  can  account  for  multi-axis  tasks  by  employing 
a  pilot  remnant,  l.e.,  extra  noise  input  to  simulate  a  human's  input  to  a 
given  task  which  is  uncorrelated  to  any  direct  command  given  to  him. 

The  development  of  the  remnant  model  is  detailed  by  Graham,  et.  al. , 

[6]  with  the  specific  parameters  chosen  for  this  work  outlined  elsewhere 
[17].  The  remnant  allows  for  display  observation  in  three  axes  while  the 
crossover  model  only  accounts  for  each  one  independently.  The  parameter  values 
chosen  for  this  work  also  allow  for  approximately  22%  for  scanning  time  of  the 
other  instruments. 

This  correlated  noise  can  be  written  in  vector-matrix  form. 


x  •• 

r 


(10) 


The  use  of  these  pilot  and  remnant  models  is  contingent  upon  the  single 
most  critical  assumption  of  this  work:  a  system  design  using  a  well-behaved, 
somewhat  contented,  human  operator  model  will  evoke  similar  responses  from 
pilots  in  actual  application  of  the  designed  system. 

The  necessity  of  accurate  control  of  aircraft  on  landing  approach  demands 
adequate  compensation  for  all  inputs  into  the  system.  Because  wind  gusts 
provide  an  intense  stochastic  disturbance,  the  treatment  of  this  input  requires 
most  careful  consideration. 

Gusts  are  inserted  into  the  plant  as  gaussian  random  variables  which  are 
added  to  their  respective  state  variables  forming  the  total  plant  input.  This 
is  illustrated  with  the  angle  of  attack  state 


a  -  a  +  a  (11) 

a  g 

The  Dryden  spectral  form  [18]  provides  the  appropriate  representation  for 
linear  analysis.  This  form  is  recommended  by  the  FAA  [19]  and  military  [18] 
for  use  in  control  systems  design  and  analysis. 

Table  1  contains  the  gust  response  levels  used  for  this  investigation. 


Standard  Deviation 
(direction) 

Value 

oy (forward) 

10  ft/sec 

(lateral) 

10  ft/sec 

a  (vertical) 
w 

6.5  ft/sec 

Table  1.  Gust  Parameters 


Again,  for  this  linear  analysis  the  state  variable  approach  can  be  used. 


x  ■  Ax  +  G  n 
g  g  g  g  g 


(12) 


x„  is  an  eighth  order  vector  containing  one  forward  velocity  state,  two 
lateral,  tvo  vertical,  and  a  state  for  each  of  the  three  rotational  gusts. 
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The  control  surfaces,  as  well  as  the  throttle,  cannot  respond  lnstantan 
eously  to  commands.  The  dynamic  models  used  were  first  order  lags  represent¬ 
ing  the  approximate  delays.  For  all  control  surfaces,  elevator,  aileron  and 
rudder,  the  time  constants  were  chosen  to  be  0.1  second.  For  the  throttle 
delay  a  time  constant  of  one  second  was  used.  In  vector-matrix  form  these 
dynamics  become 


x  -  A  x  +  B..  ut.  +  B  x  .  +  G  x 
c  c  c  th  th  c  pi  c  r 


(13 


u  ,  is  the  throttle  command  and  x„  is  defined  as 
th  c 


el 


th 


al 


rd  J 


(14 


One  can  now  write  an  overall  state-vector  differential  equation  (2) 
for  the  entire  system. 


S  ■  V.  +  V.  +  G.\ 


(15 


where 


As  " 


0 

0 

0 

0 


0 

B 


0 

0 

0 


Pi 


0 

0 


0 

0 


0 

G 

c 

0 

0 


(16 
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MEASUREMENTS  AND  FILTERING 


The  use  of  feedback  control  in  any  system  requires  measurement  of  a 
number  of  observed  output  variables.  This  may  or  may  not  pose  a  problem  for 
a  given  system.  The  established  engineering  developments  In  attitude  control 
of  aircraft  has  led  to  experienced  use  of  measuring  devices  for  sensing  the 
attitude  states,  i.e.,  p,  q,  r,  <fr,  9  and  t|>.  For  the  present  work  these 
measurements  are  assumed  to  be  available  and  shall  be  used. 

The  translational  states,  x,  y,  z,  x,  y,  and  z,  must  gain  more  attention 
as  these  are  rarely  measured  directly.  The  position  states  are  supplied  by 
the  scanning  beam  microwave  landing  system.  The  MLS  azimuth  scanner  provides 
horizontal  angular  position,  while  a  vertically  swept  microwave  unit  would  a 
allow  an  aircraft  to  derive  elevation  angular  position.  The  addition  of 
distance  measurement  equipment  (DME)  completes  the  three  dimensional  position 
set.  The  measurement  noise  model  for  the  azimuth  and  elevation  angular 
measurements  is  exponential  correlated  noise  [6].  The  total  measurement  noise 
model  can  be  expressed  In  the  vector-matrix  form. 


x  -Ax  +  G  n 
mw  raw  raw  raw  raw 


where 


8^,  azimuth  measurement  perturbation 


a  .  elevation  measurement  perturbation 


(26) 


Parameter 

Description 

Value 

T 

o 

Sample  interval 

0.2 

°2 

Elevation  angular 

0.66  mrad. 

noise  standard 
deviation 

a 

Azimuth  angular 

0.50  mrad. 

y 

noli^e  standard 

deviation 

Table  2.  Microwave  Disturbance  Model  Parameters 


The  range  measurement  disturbance  model  ie  generally  represented  as 
Gaussian  white  noise.  The  RTCA  signal  format  team  report  recommendation  [1]  Is 
aDME  -  20  ft. 

The  approach  phase  prior  to  the  straight-in  final  is  where  curved 
maneuvers  take  place.  It  has  been  suggested  that  first-order,  low-pass 
filters  are  sufficient  for  signal  smoothing  [1,23,6].  The  modeling  of  the 
measurement  process  for  this  work,  therefore,  consists  of  passing  each  of  the 
position  measurements  through  a  first-order  filter  with  a  time  constant  of 
0.0S  seconds. 


LIMITED  STATE  FEEDBACK 


Using  the  performance  Index  (1)  with  the  differential  constraint  (2) ,  m 
measurements  are  taken  y(t)  and  these  are  related  to  x(t)  through  H  (an  mxn 
matrix  with  rank  m) . 

y(t)  -  H  x(t)  (27) 

The  plant  matrix  a  is  modified  by  assuming  a  feedback  control  law  with 
an  unknown  gain  matrix  F  (rxm  matrix) . 

u(t)  -  -Fy (t)  (28) 

This  defines  the  controlled  plant  as 
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A  -  A  -  BFH  (29 

u 

with  the  differential  state  equation  (2)  becoming 

x  ■  A^x  +  Gq  (30 


The  covariance  matrix  is  defined  as 


X(t)  ■  E[x(t)x(t)  ]  (n  x  n  matrix) 


(31 


and  has  the  following  differential  equation 


X  -  XA^  +  AuX  +  GGT,  E[n(t)n(r)T]  -  I6(t-t) 


(32 


For  our  purposes  the  steady  state  case,  i.e.,  X  ■  0,  is  sufficient. 
The  performance  index  can  be  restated  in  terms  of  this  covariance 
matrix. 


T  T 


J  -  trace  { (Q  +  H  F  RFH)X> 


(33 


The  problem  is  now  a  parameter  optimization  with  an  algebraic  con¬ 
straint  (32) .  Augmenting  J  with  a  multiplier  term  results  in  a  new  perform¬ 
ance  index,  one  without  an  algebraic  constraint. 


J’  -  trace  { (Q  +  HTFTRFH)  •  X  +  P(XA*  +  AuX  +  GGT)> 


(3< 


P  is  a  constant  multiplier  (nxn  matrix) . 


Differentiating  (34)  with  respect  to  X,  P,  and  F,  respectively,  yields 
the  necessary  conditions  for  an  extremum  for  J.  (*  Indicates  the  optimum 
for  each  matrix) . 


-  A*Tp*  +  P*A*  +  Q  +  HTF*TRF*H  *  0  (3f 

3X  u  *  u 

3  T '  T  T 

~  -  X*A*  +  A*X*  +  GG  =  0  (3( 

3P  u  u 


3J' 


2(RF*H  -  BTP*)X*HT  =  0 


(3 


These  equations  take  certain  familiar  forms.  Equation  (35)  is  the 
Matrix  Riccati  condition  used  in  full  state  optimal  feedback  control. 

Equation  (36)  is  the  steady-state  covariance  matrix  definition  (32).  If  one 
solves  Equation  (37)  for  F*,  the  result  is 

F*  -  r”1BTP*X*HT(HX*HT)’'1  (38) 


These  necessary  conditions  prove  very  difficult  to  solve  for,  and 
while  there  are  algorithms  proposed  [13,14],  these  are  very  slow.  The  one 
used  here  has  near  second  order  convergence  [17]  and  is  summarized  as  follows: 

(K) 

1.  Guess  F'  '  with  the  increment  parameter,  K,  set  to  zero. 

2.  Solve  (36)  and  (35)  with  defined  by  (29)  for  X(K)  and  P(K). 

3.  Use  (38)  to  define  a  stepping  direction,  i.e., 

x^vr1  (39> 

4.  Use  cubic  interpolation  [20]  or  some  other  unidirectional  search 
technique  to  find  the  directional  minimum. 

5.  Employ  some  convergent  stopping  condition  to  decide  if  the  process 
can  be  terminated. 

6.  If  a  new  iteration  is  necessary,  set  K  ■  K  +  1  and  go  back  to  2. 


The  problem  of  making  an  initial  guess  to  achieve  a  global  optimum  is 
rarely  easy  for  any  iterative  scheme.  Here  the  difficulty  is  compounded  as 
the  limited  feedback  problem  is  not  only  multimodal,  but  a  guess  which 
stabilizes*  the  system  is  mandatory  before  the  procedure  can  be  initiated. 

One  is  tempted  to  make  the  initial  guess  be  the  feedback  gains  from  the  full 
state  measurement  optimal  solution  after  the  appropriate  elements  of  F 
corresponding  to  the  unmeasured  states  are  set  to  zero.  This  not  only  fails 
to  guarantee  a  guess  in  the  lowest  valley  of  J  but  possibly  will  not  even 
stabilize  the  initial  augmented  plant.  Methods  for  systematically  phasing  out 
unwanted  gain  elements  are  described  in  detail  elsewhere  [17,21]. 


OPTIMAL  FEEDBACK  TECHNIQUES 

The  use  of  limited  feedback  optimal  control  allows  unconstrained  model 
building  as  the  extra  state  variables  need  not  be  accounted  for  in  the  output 
vector.  A  number  of  simplifications  can  be  employed  that  help  provide  a 
better  initial  guess  for  the  limited  state  feedback  algorithm  from  the  full 
state  feedback  solution  and  more  efficient  use  of  the  limited  feedback  computer 
scheme. 


Stability  in  this  sense  means  all  negative  real  parts  to  eigenvalues  of  A-BFH. 
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In  an  effort  to  make  the  design  procedure  self-contained,  the  insertion 
of  control,  measurement  and  filter  dynamics,  along  with  the  appropriate  noise 
inputs,  is  necessary.  To  reduce  the  number  of  feedback  states  from  that  for 
the  full  state  design  procedure,  the  simplest  possible  dynamics  were  used  for 
the  feedback  design  and  the  complete  system  dynamics  were  inserted  for  the 
covariance  matrix  calculation.  This  idea  is  somewhat  justified  by  the 
separation  theorem,  but  the  intuitive  justifications  and  practical  reasons 
are  even  more  appealing. 

An  example  of  this  idea  is  the  elevator  control  input.  Modeled  as  a 
first-order  lag  in  this  research,  the  feedback  design  was  performed  by 
by-passing  the  control  dynamics.  After  the  gains  were  calculated,  the  feedback 
was  applied  to  the  control  dynamic's  input  and  the  covariance  matrix  was 
calculated.  This  procedure  resulted  in  eliminating  the  unwanted  f  edback  gains 
corresponding  to  the  elevator  state  but  fully  taking  the  elevator  lag  into 
account  for  the  covariance  test. 

This  idea  proved  so  successful  for  the  full  state  feedback  calculations, 
in  terms  of  the  satisfactory  results  obtained,  that  it  was  also  used  for  the 
limited  feedback  program,  but  for  another  reason.  Using  the  theory  of  limited 
state  control  fully  takes  into  account  the  desire  to  eliminate  the  unwanted 
states  while  retaining  their  respective  dynamics.  The  high-order  dynamics, 
however,  require  correspondingly  more  computer  time.  Since  the  calculations 
are  mostly  matrix  multiplications,  the  required  computer  time  Increase  is 
proportional  to  the  cube  of  the  system  order.  Using  these  simplifications  does 
remove  the  more  accurate  situation  of  using  complete  system  dynamics  in  the 
design  phase,  but  all  dynamics  are  still  included  in  the  covariance  test. 

Figure  2  illustrates  the  idea  of  adding  dynamics  for  testing  the  gains. 
The  figure  is  descriptive  of  both  the  limited  and  full  state  design  except 
that  the  gust  dynamics  are  not  necessary  for  the  full  state  feedback  design 
phase.  The  limited  feedback  design  is  still  needed  to  eliminate  some  states, 
i.e.,  pilot,  gust,  and  velocity. 


RESULTS 

The  landing  approach  task  for  the  Breguet  aircraft  is  composed  of  two 
somewhat  distinct  phases.  The  portion  of  the  approach  of  interest  here  takes 
place  between  approximately  4  miles  from  the  runway  to  approximately  2000  ft. 
from  touchdown  [4].  The  three  dimensional  nature  of  the  coverage  allows 
curved  maneuvers  along  the  initial  approach  phase.  This  is  in  contrast  to  the 
final  approach  where  the  necessity  of  allowing  a  final  trim  up  of  the  aircraft 
for  landing  precludes  dynamic  maneuvers  inside  the  2000  ft.  point. 

All  the  dynamic  states  described  previously  are  summarized  in  Table  3. 

Of  all  the  longitudinal  and  lateral  states,  the  twelve  chosen  for  measurement 
represent  a  balance  between  the  ease  of  measurement,  the  importance  of  contri¬ 
bution,  and  filtering  necessary.  As  mentioned,  the  attitude  states,  <j>,  6,  ip, 
p,  q  and  r  are  easily  measured  and  useful  for  attitude  control.  The  position 
states,  x,  y  and  z  are  necessary  for  path  control  and  are  provided  by  the  MLS  and 
filtered  to  produce  x  ,  y  and  z  .  The  velocity  states  £,  y,  and  z  provided  the 


Longitudinal  Lateral 

State  Description  State  Description 


*  ** 

X 

forward  position 

* 

y 

lateral  position 

*  ** 
z 

vertical  position 

*  ** 
p 

roll  rate 

*  ** 
q 

pitch  rate 

*  ** 

*  * 

roll  angle 

*  ** 

6  » 

pitch  angle 

*  ** 
r 

yaw  rate 

*  ** 

P6el 

pilot  elevator  1 

*  ** 

yaw  angle 

* 

p<5e2 

pilot  elevator  2 

*  ** 

P6al 

pilot  aileron  1 

.* 

X 

forward  velocity 

*  ** 

P6rl 

pilot  rudder  1 

.* 

z 

vertical  velocity 

p6a2* 

pilot  aileron  2 

{el 

elevator 

* 

P6r2 

pilot  rudder  2 

Sth 

throttle 

.* 

y 

lateral  velocity 

X 

m 

forward  measurement 

5al 

aileron 

z 

m 

vertical  measurement 

Srd 

rudder 

u 

as 

airspeed 

ym 

lateral  measurement 

a 

y 

m-w  azimuth  noise 

a 

y 

m-w  azimuth  angle 

a 

z 

m-w  elevation  noise 

P6 

pilot  aileron  remnant 

a,  rem 

P<5 

pilot  elevator  remnant 

P6 

pilot  rudder  remnant 

e,  rem 

r ,  rem 

u 

g 

forward  gust 

Vgl 

lateral  gust  1 

w 

gl 

vertical  gust  1 

Vg2 

lateral  gust  2 

Wg2 

vertical  gust  2 

Pg 

roll  gust 

qg 

pitch  gust 

r 

g 

yaw  gust 

*full  state  gains  required 

**limited  state  gains  required 

Table  3.  Total  System  State  Vector 
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Halted  state  feedback  algorithm  with  the  most  difficult  elimination  task. 

These  states  would  be  very  helpful  for  path  and  attitude  control,  but  as  they 
require  acceleration  Integration  or  reconstruction  which  Is  most  difficult, 
the  possibility  of  leaving  them  out  of  the  design  was  pursued.  The  pilot 
output  states,  P.  were  chosen  for  their  accessibility  and  their 

effect  on  overallperformance. 

As  mentioned  previously,  banked  maneuvers  along  the  initial  approach 
path  require  that  the  pilot  handle  those  maneuvers  with  the  same  ease  as  level 
flight.  Table  4  shows  the  stochastic  responses  for  the  Breguet  aircraft  flying 
at  steady  state  bank  angles,  but  using  the  compensation  separately  designed 
for  the  uncoupled  longitudinal  and  lateral  dynotics.  In  most  cases  the 
responses  increase  with  bank  angle,  but  the  changes,  up  to  30°  banking,  are 
quite  small.  In  addition  it  can  be  speculated  that  gains  for  coupled  dynamics, 
if  calculated,  would  be  small  and  demonstrate  little  improvement  over  the 
observed  results. 

The  design  to  this  point  has  been  predicated  on  the  notion  that  the 
pilot  would  actually  adopt  the  behavior  represented  by  the  pilot  model.  It 
has  been  demonstrated  that  with  this  performance  index  and  a  given  system  [9] , 
the  pilot  will  adopt  a  behavior  which  minimizes  his  tracking  error.  An  appro¬ 
priate  rating  can  then  be  assigned  to  the  pilot  dynamics. 

At  this  point  it  might  be  useful  to  examine  a  pilot  evaluation  technique 
seemingly  independent  of  the  pilot-in-the-loop  design  philosophy.  The 
frequency  domain  investigations  into  pilot  model  and  rating  techniques  [8,10, 
15,5]  have  been  in  use  longer  than  the  more  modern  control  approach  [9]. 

Numerous  system  parameter  guidelines  and  pilot  model  parameters  have  been  set 
down  as  a  result.  The  pilot  model  used  in  this  research  was  developed  using 
such  techniques. 

For  such  analysis,  one  must  restrict  the  evaluation  to  single  input-single 
output  transfer  functions.  Breaking  B  and  F  into  vectors 


3a  Responses 


670.44 

672.04 

679.26 

697.87 

0.2980 

0.2970 

0.2940 

0.2915 

0.4119 

0.4118 

0.4119 

0.4127 

0.1726 

0.1711 

0.1869 

0.2023 

The  pilot  transfer  function  can  now  be  inserted  to  result  in  the  total 
open- loop  function  for  each  pilot  control  axis. 


Mi(ju) 


f^ttwl  -  A)“1bi 


e _ 

(TLju  +  1) 


(42) 


i  ■  el,  al,  and  rd 


The  published  guidelines  (0,  10,  15,  5)  for  the  frequency  response  of 
M^(jw)  can  be  summarized  as  follows: 

1.  For  best  ratings  the  pilot  adjusts  his  gain  to  place  a  good 
stretch  of  -1  slope  rolloff  of  log  magnitude  of  versus  log 
frequency  in  the  region  of  the  crossover  frequency,  i.e.,  where 
the  magnitude  of  M^(ju)  equals  unity. 

2.  The  crossover  frequency  should  be  between  approximately  2  rad/sec 
and  7  rad /sec. 

3.  The  pilot  rating  is  degraded  with  poor  phase  margin. 

One  important  guideline  is  pilot  gain  versus  rating,  but,  as  outlined 
earlier,  the  gain  of  the  display  variables  can  be  adjusted  to  accommodate 
this. 


Of  the  three  axes  examined  only  the  aileron  and  elevator  results  are 
displayed.  The  rudder  task  easily  satisfied  all  of  the  criteria  mentioned. 
The  aileron  and  elevator  tasks  have  much  more  interesting  interpretations. 

Figure  3  shows  the  aileron  open-loop  frequency  characteristics.  The 
magnitude  plot  demonstrates  the  good  characteristics  at  the  crossover  region. 
The  phase  plot,  however,  reveals  a  problem.  Using  the  design  delay  time 
constant,  T^  «  0.3  seconds,  results  in  a  low  phase  margin.  If  one  uses  a 
lower  value,  say  TN  -  0.2  instead,  this  problem  is  cleared  up. 

The  question  that  arises  is  does  this  compromise  the  design  for 
minimum  tracking  task?  The  answer  is  no.  It  was  never  assumed  that  the 
pilot  would  adopt  the  exact  behavior  used  in  the  design.  The  T  ■  0.3  value 
was  chosen  to  provide  an  upper  bound  or  worst  case  design  challenge  with  the 
intent  of  influencing  the  feedback  structure  with  the  pilot's  ultimate 
limitations.  A  trained  pilot  can  easily  adopt  a  T  of  0.2  seconds  and  other, 
more  rating  degrading,  compensation,  such  as  that  represented  by  the  lead 
term  in  equation  (15)  is  still  unnecessary.  A  question  now  arises  about  the 
overall  performance  with  this  parameter.  Table  5  shows  the  output  responses 
for  the  same  feedback  gains  calculated  earlier  but  with  both  pilot  delay 
constants  being  used.  Without  exception  the  system  responses  improved  with 
the  greater  pilot  concentration. 

By  designing  the  feedback  gains  with  somewhat  lazy  pilot  dynamics,  it 
was  hoped  that  the  pilot  characteristics  would  have  a  greater  influence 


3a  Responses,  *  0 


State 

Units 

Tn  -  0.3 

Tn  -  0.2 

y 

ft 

310.0 

262.9 

• 

y 

ft/ SeC 

19.51 

16.74 

p 

deg/sec 

19.99 

10.85 

♦ 

deg 

8.40 

5.58 

r 

deg/sec 

4.89 

4.33 

* 

deg 

6.23 

5.72 

p<5al 

— 

0.3918 

0.2275 

p6a2 

— 

0.3734 

0.2275 

P6rl 

— 

0.1683 

0.1517 

p6r2 

— 

0.1658 

0.1498 

6fl 

deg 

18.64 

10.25 

6r 

deg 

9.94 

8.95 

6 

ac 

— 

0.4119 

0.2369** 

6 

rc 

— 

0.1726 

0.1552** 

**  The  pilot  remnant 

input  values 

are  - 

3  a 

ac 

-  0.31,  3a 

rc 

-  .17 

Table  5.  System  Response  for  Different  T^'s 
(45°  flaps  and  177  ft’/sec  airspeed) 
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in  the  final  structure  than  a  more  demanding  pilot  model.  These  results 
indicated  that  the  pilot  now  has  a  certain  range  of  parameter  variation  which 
yields  good  task  performance. 

The  second  frequency  response  curve,  Figure  4,  describes  the  elevator 
control  task.  The  interpretation  here  is  far  more  difficult  than  the  previous 
two  cases.  The  magnitude  slope  at  the  crossover  point  approaches  -2  which 
indicates  that  pilot  differentiation  is  necessary  to  raise  this  to  an  overall 
system  crossover  slope  of  -1.  This  is,  however,  somewhat  compromised  by  the 
fact  that  the  crossover  frequency  itself  is  lower  than  normal,  wc  *  2.6, 
allowing  slower  pilot  compensation. 

Discarding  the  temptation  to  add  further  compensation,  e.g.,  leadiag 
compensator  or  stability  augmentation,  a  look  at  the  limitations  of  the 
feedback  structure  perhaps  can  help  explain  the  result.  Given  that  all  the 
compensation  passes  through  the  pilot,  via  the  display  signals,  and  no  loop 
closing  is  performed  otherwise,  then  the  system  poles  are  not  changed  by  the 
feedback  structure  in  the  open-loop  sense.  The  feedback  structure,  therefore, 
constrains  the  performance  to  allow  only  zero  changes  which  could  leave  the 
design  process  powerless  to  compensate  for  certain  pole  characteristics. 


SUMMARY.  CONCLUSIONS  AND  RECOMMENDATIONS 

The  use  of  optimal  feedback  control  theory  for  this  work  provides  the 
control  designer  with  a  precise  design  objective.  The  regulation  of  a  command 
flight  path  in  the  face  of  stochastic  inputs  is  a  natural  application  for  the 
performance  index  chosen. 

The  use  of  the  pilot-in-the-loop  analysis  influenced  the  control  design 
in  favor  of  the  pilot's  dynamic  limitations.  The  results  indicate  that 
designing  for  worst  case  pilot  response  and  testing  using  a  more  demanding 
pilot  model  did  demonstrate  improved  response. 

The  pilot  remnant  disturbance  model  is  perhaps  the  newest  and  most 
untested  portion  of  the  pilot  modeling  process.  Its  use  here  was  not  intended 
to  lump  the  entire  pilot  input  not  dictated  by  the  crossover  model  into  a 
single  quantity.  As  yet  there  is  no  mathematical  way  of  doing  this.  It  has 
been  demonstrated  in  the  past,  however,  that  this  quantity  somewhat  simulates 
the  pilot's  performance  in  a  multitask  environment.  After  using  this  disturb¬ 
ance  model  in  a  design  effort,  one  can  better  understand  its  influence.  The 
remnant  does  provide  an  input  into  the  problem  which  is  at  least  intuitively 
justified.  The  crossover  model  suffers  from  the  mathematical  fact  that  the 
more  one  requires  of  it  at  input  the  more  one  achieves  as  an  output.  The 
remnant  was  useful  in  dictating  a  point  of  diminishing  returns  for  the  command 
inputs.  This,  more  than  any  other  design  criterion,  kept  the  pilot  control 
activity  at  a  low  level. 

Limited  state  feedback  control  theory  plays  a  large  part  in  this  design 
effort.  The  algorithm  developed  represents  a  major  portion  of  the  overall 
design  effort.  Its  greatest  utility  comes  in  eliminating  states  which  cannot 
be  reasonably  deleted  from  the  design  phase.  The  paper  by  Mendel  [22]  brings 


this  entire  area  into  better  focus.  His  work  dealt  with  the  need  for  account¬ 
ing  for  all  stochastic  inputs,  disturbance  and  measurement  noises  into  the 
full  state  feedback  design.  Although  explicitly  removed  from  the  design 
process  by  the  separation  theorem,  these  noises  must  be  observed  and  compensa¬ 
tion  adjusted  accordingly.  This  idea  leads  to  the  combination  of  dynamic 
by-pass  for  this  design  work  with  the  reinsertion  into  the  final  covariance 
check. 

The  results  of  this  work  have  led  to  a  number  of  conclusions  about  the 
landing  approach  problem  for  manual  control  and  stochastic  regulation  in 
general.  An  excessive  vertical  acceleration,  2,  was  observed  which  shows  the 
need  for  special  compensation.  Hie  performance  index  weightings  were  adjusted 
to  bring  this  down  with  no  success.  A  vertical  accelerometer  could  help 
alleviate  this  problem  but  it  is  doubtful  that  feeding  an  accelerometer  state 
to  a  pilot  is  feasible  as  he  could  not  respond  fast  enough  to  the  situation. 

A  feedback  ahead  of  the  pilot  (stability  augmentation)  is  necessary  here. 

The  pllot-ln-the-loop  design  idea  hps  been  used  with  Increasing  regularity 
in  the  past  couple  of  years.  The  usage  here  was  unique  in  that  the  feedback 
structure  was  completely  unconstrained,  i.e.,  any  state  could  contribute  to  any 
command.  The  design  stops  with  the  display  set.  The  actual  implementation  can 
take  many  forms:  compensatory,  pursuit,  or  combinations  of  the  two.  It  is 
believed  that  this  does  not  preclude  other  visual  cues,  e.g.,  runway  pictoral 
or  projected  glidepath.  The  design  phase  here  does  represent  a  logical  break 
point  between  design  and  analysis  and  investigations  of  implementation  proced¬ 
ures  . 

Although  the  design  techniques  employed  produced  results  generally 
acceptable  for  the  initial  approach  phase,  to  obtain  even  better  results,  the 
need  for  all  compensation  to  go  through  the  pilot  must  be  removed.  Allowing 
the  attitude  states,  i.e.,  <J>,  8,  ip,  p,  q,  r  and  perhaps  accelerometer  states, 
to  be  fed  into  the  system  ahead  of  the  pilot  should  remove  much  of  the  attitude 
regulation  task  from  the  pilot's  attention.  This  can  be  performed  by  classical 
stability  augmentation  design  procedures  or  an  optimal  control  design  identical 
to  this  one  employed  without  the  microwave  measured  path  states  or  pilot  model 
in  the  design  loop.  One  control  task  already  mentioned  for  this  type  of 
augmentation  is  the  vertical  acceleration  excursion  problem.  The  complete 
path  is  then  closed  with  a  pilot-in-the  loop  design  as  employed  here.  The 
attitude  states  are  still  allowed  to  be  used  but,  in  this  case,  they  would 
serve  only  the  path  control.  This  later  design  idea  could  perhaps  be  combined 
into  a  single  synthesis  procedure  by  allowing  use  of  attitude  states  for  both 
ahead-of-the-pilot  and  through-the-pilot  compensation. 

The  increased  use  of  high  speed  digital  computers  doing  state  variable 
control  analysis  allows  larger  dynamic  model  size  representing  more  complete 
descriptions  of  the  physical  situations  in  the  design  loop.  Many  dynamic 
situations  within  the  entire  model  can  be  validly  argued  to  be  insignificant. 

The  use  of  modern  algorithms  for  evaluating  Lyapunov  equations,  such  as  the 
covariance  matrix  definition,  however,  makes  total  system  dynamic  testing  for 
steady  state  stochastic  response  efficient  and  complete. 

Finally,  the  use  of  pilot  states  for  feedback  in  the  design  was  accom¬ 
plished  with  output  states  of  the  pilot,  i.e.,  input  to  control  deflections,  in 


Che  feedback  structure.  These  states  were  used  for  two  reasons.  They  were 
easily  accessible  as  one  needs  to  merely  attach  appropriate  measuring  devices 
to  the  control  stick  and  rudder  pedals.  The  second  reason  is  that  they  improve 
the  performance  of  the  pilot  in  the  control  task.  Supplying  the  operator  with 
an  adjustment  for  his  own  dynamic  behavior  had  a  more  explicit  influence  in 
the  feedback  design  than  just  including  the  pilot  as  an  unattainable,  filter. 

The  testing  of  the  design  gains  over  more  than  one  set  of  pilot  parameters 
removes  the  fear  that  these  gains  are  only  valid  for  the  pilot  time  constants 
used  in  the  design,  yet  it  is  believed  that  using  the  second  pilot  states, 
the  derivatives,  would  assume  too  much  of  the  model.  The  use  of  pilot  states 
in  the  feedback  structure  with  larger  pilot  model  parameter  variations  is  an 
area  for  future  research. 
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A  CONTROL  AUGMENTATION  CONCEPT  FOR  IMPROVED  MANUAL  CONTROL 
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ABSTRACT 


The  types  of  tasks  involved  in  many  Air  Force  missions  dictate  that 
the  pilot  must  be  an  active  control  element  in  order  to  exercise  maximum 
flight  path  flexibility.  As  a  control  element,  however,  the  human  pilot 
haa  two  limitations.  One  is  the  frequency  response  required  for  short 
term  stabilization,  and  the  other  is  the  ability  to  concentrate  on  many 
demanding  tasks  at  the  same  time. 

The  V/STOL  IFR  Control/Display  Technology  Program  conducted  by  the 
Air  Force  Flight  Dynamics  Laboratory  has  developed  a  control  system  to 
overcome  the  pilot  limitations  while  enhancing  his  performance  and  decision¬ 
making  flexibility  as  an  active  control  element.  This  system  includes  a 
highly  flexible  V/STOL  aircraft  flight  director  which  feeds  only  the  high- 
frequency  control  inputs  to  a  simple,  limited-authority  automatic  stability 
augmentation  system.  The  low-frequency  control  commands  are  displayed  to 
the  pilot  to  be  executed  manually. 

Using  the  techniques  of  analysis,  simulation,  and  flight  testing,  this 
concept  has  been  verified  to  improve  performance  and  decrease  workload  while 
retaining  the  natural  pilot  flexibility.  Pilot  control  inputs  required  to 
fly  any  given  profile  are  reduced  in  number  and  quickness  of  response. 
Through  the  elimination  of  high-frequency  control  inputs,  the  aircraft  is 
more  flyable  and  the  pilot  can  devote  more  attention  to  analyzing  his 
situation  and  the  progress  of  the  mission. 

Such  a  control  system  has  been  implemented  and  flight  tested  in  the 
dynamic  maneuvering  control  of  cyclic  pitch  on  a  CH-3E  helicopter.  Future 
work  is  recommended  to  optimize  the  complementing  of  manual  and  automatic 
functions,  to  evaluate  the  effectiveness  of  the  control  concept  under 
operational  conditions,  and  to  extend  the  concept  to  other  control  applica¬ 
tions  . 


NOTATION 


s  =  Laplace  operator 

Tj  =  time  constant,  pilot  model 

T2  ■  time  constant,  pilot  model 
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■  time  constant,  pilot  model 
C  =  damping  ratio,  2nd  order  system 
0C  *  basic  cyclic  pitch  command 


INTRODUCTION 

The  problem  of  interfacing  a  human  pilot  and  a  dynamic  aircraft, 
particularly  under  instrument  weather  conditions,  has  been  the  focus 
of  many  development  programs.  This  problem  is  now  appearing  again  with 
the  advent  of  STOL  and  V/STOL  instrument  (IFR)  operations,  such  as  with 
the  AMST  or  the  Army’s  new  helicopters.  The  deficiencies  which  prevent 
effective  IFR  utilization  of  these  vehicles  lie  in  the  areas  of  stabili¬ 
zation  and  control  systems,  pilot  displays,  flight  path  sensors,  and 
appropriate  guidance  sources. 

The  best  solution  to  these  deficiencies  is  one  which  integrates 
developments  in  each  of  these  areas  into  a  total  compatible  system.1 
V/STOL  mission  requirements  define  four  criteria  that  will  guide  the 
design  of  such  a  system,  to  ensure  maximum  operational  effectiveness: 

(1)  flight  path  flexibility,  (2)  precision,  (3)  low  pilot  workload,  and 
(4)  simplicity  at  low  cost.  However,  these  requirements  are  somewhat 
interrelated. 2 

The  Air  Force  Flight  Dynamics  Laboratory  is  conducting  a  development 
program  that  has  made,  significant  progress  in  defining  an  operational 
V/STOL  control/display  system,  aimed  at  meeting  these  four  requirements. 
The  approach  taken  during  this  development  program  to  arrive  at  a  workable 
solution  includes  four  steps.  First,  the  task  or  problem  is  defined  in 
terms  of  the  results  desired.  Then  analysis,  simulation,  and  flight 
testing  are  employed  to  develop  the  solution  and  verify  the  results.  The 
systems  integration  and  flight  evaluations  are  accomplished  on  a  CH-3E 
helicopter. 


OVERALL  CONTROL  CONCEPT 


Extensive  effort  was  expended  in  determining  the  optimum  overall 
control/display  concept,  keeping  in  mind  the  four  constraints  listed  above. 

The  first  trade  off,  and  the  one  reported  herein,  concerned  the 
degree  of  manual  "~trol  vs  automatic  control.  Pilot  frequency  response 
limitations  dictate  that  some  automaticity  in  the  form  of  stability 
augmentation  be  employed,  if  only  for  aircraft  attitude  stabilization. 
Beyond  automatic  stability  augmentation,  however,  the  choice  is  less  clear. 
Automatic  control  systems  can  remove  some  of  the  pilot  workload  and  give 
repeatable,  good  performance,  when  the  task  is  well  defined.  They  do, 
however,  require  extensive  failure  monitoring  by  the  pilot  in  critical 
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flight  conditions.  This  distracts  him  from  the  primary  mission.  Also, 
since  the  pilot  is  not  directly  flying  the  aircraft,  he  must  step  in 
and  re-establish  positive  control  of  the  vehicle  when  a  partial  or  total 
failure  occurs. 

Another  important  consideration  is  that  the  pilot  alone  can  make 
decisions  and  choose  alternatives  when  faced  with  difficult  or  unforeseen 
conditions.  On  the  other  hand,  a  pilot  who  is  burdened  with  many  tasks 
cannot  afford  the  time  or  attention  to  exercise  his  authority  or  options. 
For  these  reasons,  the  best  system  is  one  in  which  the  pilot  is  an  active 
element  and  not  just  a  monitor  of  automatic  performance. 

The  solution  that  has  been  adopted  for  the  AFFDL  control/display 
system  is  one  where  the  pilot  is  included  as  a  primary  control  element  in 
the  design  of  the  overall  system.  This  means  that  there  are  certain  tasks 
which  are  directly  assigned  to  him,  some  that  are  shared  with  automatic 
controls,  and  some  that  are  completely  automatic  under  normal  conditions. 

Among  the  tasks  selected  for  the  pilot  to  do  are  those  »hich  offer 
the  greatest  benefits  in  flexibility  and  performance  under  Kman  control. 

In  this  area  are  the  dynamic  maneuvering  controls  of  cyclic  pitch  and 
roll  and  the  selection  or  modification  of  the  flight  profile  to  satisfy 
the  mission  requirements.  The  role  of  the  automatic  control  system  is 
threefold:  Uncoupling  of  the  pilot's  control  inputs,  elimination  of  the 
manual  coordinating  functions,  and  a  simplifying  of  his  primary  control 
tasks. 

The  primary  element  of  the  control/display  system  is  a  3-cue  flight 
director,  which  is  mechanized  to  directly  control  the  aircraft  velocity 
vector  through  airspeed,  flight  path  angle,  and  heading/course  control. 

The  cyclic  pitch  and  roll  commands  of  the  flight  director  are  integrated 
in  the  center  of  the  attitude  director  indicator  (ADI) .  The  collective 
stick  command  is  on  the  left  of  the  ADI,  superimposed  over  a  flight  path 
angle  tape.  The  experimental  instrument  panel  layout  is  shown  in  Figure  1. 


MECHANIZATION  OF  THE  BLENDED  SYSTEM 


In  the  CH-3E  test  vehicle,  cyclic  pitch  is  the  primary  airspeed 
control.  When  flying  the  experimental  flight  contrcl/display  system,  the 
pilot  selects  a  reference  airspeed  indicator  using  a  thumb  slew  switch 
located  on  the  cyclic  grip.  Thus  he  can  change  the  reference  without 
removing  his  hand  from  the  stick  or  diverting  his  attention.  The  flight 
director  then  computes  the  proper  control  inputs  to  null  the  airspeed 
error.  The  short-term  commands  are  fed  directly  into  the  automatic  pitch 
stabilization  system,  and  the  longer-term  commands  are  displayed  to  the 
pilot  to  be  executed  manually.  Thus  the  vehicle  assumes  not  only  an 
attitude  stability,  but  a  short-term  airspeed  stability  against  longi¬ 
tudinal  gusts,  assisting  the  pilot  in  his  control  task.  The  block  diagram 
of  the  flight  director  mechanization  is  shown  in  Figure  2.  Note  that  a 
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failure  of  the  automatic  system  means  that  the  pilot  will  have  to  follow 
the  high-frequency  commands  as  well  as  the  low-frequency  ones.  However, 
his  piloting  technique  and  instrument  scan  are  as  before;  that  is,  the 
control  task  is  intensified  but  not  changed. 

Referring  to  Figure  2,  the  basic  cyclic  pitch  computation  (0C)  is 
airspeed  error  damped  with  washed-out  pitch.  For  the  noncoupled,  manual 
operation,  filtered  cyclic  stick  position  is  summed  with  6C  to  provide 
anticipatory  damping.  With  appropriate  filtering,  cyclic  stick  position 
can  be  made  to  approximate  pitch  rate.  This  approximate  pitch  rate  signal 
does  not  contain  the  effects  of  external  gusts;  it  concains  only  the  pilot 
inputs.  When  used  as  a  damping  signal,  therefore,  it  will  cause  less 
unnecessary  command  activity  on  the  ADI  than  an  actual  pitch  rate  signal. 

When  the  system  is  coupled  to  form  a  blended  system,  the  basic  cyclic 
pitch  computation,  0C,  is  slowed  down  with  a  2-second  lag  before  it  is 
displayed  on  tt»c  ADI.  At  the  same  time,  0C  is  hi-passed  and  fed  into  the 
servo  so  the  automatic  system  can  pick  up  the  high-frequency  commands.  A 
pitch  command  that  is  lagged  by  two  seconds  and  then  fed  to  the  ADI  would 
not  result  in  a  stable,  flyable  command.  Therefore,  the  lagged  command 
is  augmented  by  cyclic  pitch  stick  position  filtered  to  approximate  short 
term  pitch.  This  signal  is  used  because,  as  mentioned  above,  it  does  not 
contain  the  external  gust  effects.  The  signal  fed  to  the  automatic  system 
is  damped  with  derived  pitch  rate.  The  frequency  response  of  the  servo  is 
fast  enough  to  respond  to  and  help  damp  pitch  rate  disturbances. 

The  automatic  system  used  in  this  instance  is  the  normal  CH-3E 
Sikorsky  stability  augmentation  system  (SAS) ,  with  a  series  servo  and  10% 
control  authority.  The  high-frequency  flight  director  airspeed  command 
is  added  to  the  normal  SAS  command. 

In  normal  operations  it  was  desired  that  the  pilot  not  be  aware  of 
the  automatic  inputs.  Preliminary  analysis  showed  that  for  this  constraint 
the  best  frequency  split  between  automatic  and  manual  execution  would  occur 
about  0.5  radian/ second,  meaning  that  the  automatic  input  has  a  2-second 
washout  and  the  displayed  manual  command  appears  with  a  2-second  lag. 

The  rationale  for  using  the  0.5  radian/second  frequency  crossover 
split  can  be  visualized  by  looking  at  the  assumed,  simplified  pilot  model 
in  Figure  3.  With  the  uncertainties  of  modeling  the  display/pilot  combina¬ 
tion,  this  project  did  not  devote  a  great  effort  to  modeling  it.  Instead, 
a  simple  analytical  model  was  used  and  the  results  verified  on  a  simulator 
by  studies  using  a  good  spectrum  of  actual  pilots3.  The  linear  model  that 
was  assumed  is : 

Control  Action  (T^  s  +  1)  (T£  s  +  1) 

.  -  .  as 

Display  Movement  s  (T32s2  +  2  £  s  +  1) 
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A  plot  of  this  pilot  model  is  given  in  Figure  3. 


The  gain  parameter  is  dependent  on  the  display  gain  and  on  the 
control  column  ratio  to  the  aircraft  surface. 

The  lead  corner  frequency,  1/Tj_,  is  dependent  on  how  much  rate 
information  the  pilot  derives  from  the  background  attitude  data  of  the 
attitude  display  indicator,  but  is  somewhere  in  the  range  of  1  to  3 
radians/second.  The  integration  rollout  corner  frequency,  I/T2,  is 
again  very  display  dependent,  but  usually  occurs  between  0.1  and  0.5 
radian/second.  The  quadratic  rolloff  frequency,  I/T3,  which  occurs  at 
the  point  where  the  pilot  is  no  longer  able  or  willing  to  track  the 
display,  is  usually  modeled  at  approximately  8  radians/second. 

By  assigning  to  the  automatic  system  the  execution  of  all  inputs  of 
frequencies  greater  than  0.5  radian/second,  the  control  inputs  required 
of  the  pilot  are  those  which  he  can  integrate  and  thus  perform  most  easily 
and  effectively.  These  types  of  responses  can  be  accomplished  as  a  result 
of  his  normal  instrument  scan  without  requiring  constant  attention.  He 
can  then  devote  more  time  to  other  mission  and  flight  management  tasks. 


EXPERIMENTAL  DATA 


The  simulator  used  in  the  program  is  a  fixed-base  simulator  with 
three  degrees  of  freedom  at  a  time.  The  three  degree-of- freedom  limita¬ 
tion  is  imposed  because  of  analog  computer  capacity. 

In  the  pitch/collective  study,  the  three  degrees  of  freedom  were 
airspeed,  pitch  attitude,  and  vertical  rate.  CH-3E  dynamics  were  simulated 
with  the  SAS,  and  the  system  was  perturbed  by  2-sigma  longitudinal  and 
vertical  gusts.  The  flight  director  was  mechanized  as  in  the  aircraft, 
and  the  pilot's  task  was  to  maintain  a  reference  airspeed  and  altitude  by 
following  the  cyclic  pitch  and  collective  stick  commands.  The  performance 
and  workloads  were  compared  using  the  flight  director  commands  alone  vs 
the  blended  system  with  pitch  coupling. 

Examples  of  the  improvement  in  performance  and  workload  may  be  seen 
in  the  data  illustrated  in  Figures  4  and  5  which  was  taken  on  the  fixed- 
base  simulator.  Figure  4  shows  data  taken  with  a  manually  flown  (flight 
director  only)  system,  and  Figure  5  shows  data  taken  using  the  blended 
(coupled)  control  system.  Cyclic  stick  activity  may  be  considered  to  be 
an  indicator  of  pilot  workload  in  that  axis.  Note  the  reduction  of  about 
60%  in  the  high-frequency  cyclic  pitch  activity  with  the  blended  system. 

Figures  4  and  5  were  taken  with  a  project  pilot  flying  the  simulator. 
His  task  only  required  attention  to  two  items,  cyclic  and  collective  pitch 
commands.  Under  higher  stress  conditions,  such  as  during  terminal  area 
navigation  and  commun  cations,  his  cyclic  pitch  performance  would  have  been 
worse  with  the  flight  director  only  system  because  he  would  not  have  had 


the  luxury  of  devoting  so  much  of  his  attention  to  that  particular  task. 
Even  with  only  two  tasks  to  perform,  however,  his  workload  in  cyclic 
pitch  was  reduced  with  the  blended  system. 

As  a  result  of  the  encouraging  simulation  results,  the  blended 
control  concept  was  included  in  the  flight  director  mechanization  in  the 
CH-3E  test  aircraft.  An  extensive  pilot  evaluation  of  the  overall  system 
with  the  blended  control  concept  for  airspeed  control  is  being  conducted. 
The  results  obtained  to  date  confirm  that  the  pilot  and  the  control/display 
system  combination  do  produce  superior  performance  and  improved  workload 
and  flexibility.  Low-speed,  steep  letdowns  can  be  flown  with  precision 
and  relative  ease. 

As  a  result  of  blending  the  automatic  and  manual  control  of  airspeed 
through  cyclic  pitch  in  the  manner  described  above,  several  benefits  are 
gained.  First,  the  absence  of  high-frequency  manual  control  responses 
allows  him  to  spend  his  time  more  profitably  by  assessing  his  situation 
and  planning  his  flight  profile  than  by  exercising  short-term  airspeed 
control.  Second,  the  pitch  control  task  Itself  becomes  less  demanding 
and  more  comfortable  for  the  pilot  than  it  is  under  purely  manual  control. 
Thirdly,  the  automatic  controls,  by  washing  out  with  a  2-second  time 
constant,  do  not  interfere  with  the  normal  aircraft  handling  qualifies 
or  the  pilot' 8  control  feel  or  authority. 


CONCLUSIONS  AND  RECOMMENDATIONS 


From  the  results  to  date  in  the  Air  Force  Flight  Dynamics  Laboratory 
development  program,  it  is  apparent  that  much  can  be  gained  by  including 
the  pilot  as  an  active  element  in  the  nontrol/display  system  design. 
Flexibility  is  enhanced  because  the  pilot  is  exercising  continuous  author¬ 
ity  and  can  react  quickly  and  positively.  Precision  and  workload  are 
improved  because  the  automatic  system  can  respond  to  high-frequency 
perturbations,  improve  vehicle  flight  path  stability,  and  remove  unnecessary 
pilot  inputs  which  are  only  coordinating  functions.  Finally,  the  system 
concept  minimizes  the  cost  and  complexity  associated  with  automatic  control 
systems.  The  degree  of  required  redundancy  is  reduced  by  using  the  pilot 
as  the  primary  full -authority  control  as  well  as  the  backup  to  the  auto¬ 
matics,  and  by  limiting  the  control  authority  of  the  automatic  servos. 

The  system  concept  has  been  developed  and  flight  validated  to  a  fair 
degree  of  confidence.  Further  work  will  apply  this  concept  to  bank 
attitude  control,  where  wind  shears  and  close-range  captures  of  a  final 
approach  course  increase  the  pilot ' s  workload  to  an  unmanageable  level . 

Other  applications  may  be  considered  for  control  applications  which  have 
similar  requirements  to  those  discussed  here. 
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ABSTRACT 

The  task  of  development  and  evaluation  of  airborne  flight  displays 
to  support  approach  management  and  flight  path  control  has  had  a  slowly 
evolving  history.  A  recent  display  concept  to  provide  a  more  direct 
outside  world  pictorial  runway  representation  and  aiding  symbology  has 
been  identified  to  enhance  the  management  of  the  shuttle  recovery  for 
manual  flight  control  operations.  Of  present  interest  is  the  application 
of  human  operator  describing  function  measurements  to  help  evaluate 
this  display  in  either  a  head-down,  panel-mounted  or  head-up  windscreen 
position.  The  advantages  of  this  method  for  more  effective  man-vehicle 
display  evaluation  are  discussed,  and  utilize  the  supporting  describing 
function-analytical  performance  measure  techniques  obtained  from  four 
participating  pilots. 


INTRODUCTION 


The  display  concepts  that  would  provide  a  more  direct  pictorial 
representation  of  ’.cey  flight  situation  parameters  have  only  recently 
been  attempted  tnrough  various  types  and  stages  of  head-up  displays 
(references  1,2).  This  approach  was  conceived  to  provide  the  pilot 
better  monitoring  or  manual  takeover  features  rather  than  the  more 
abstract  and  symbolic  representations  provided  by  conventional  attitude  - 
directors  and  flight  situation  instruments.  A  preliminary  analysis  of 
pilot  task  requirements  and  display  requirements  during  the  unpowered 
terminal  area  maneuvering  and  final  approach  sequences  for  the  Space 
Shuttle  reentry  vehicle,  indicate  that  flight  information  based  on  an 
outside  world  perspective  display  concept  of  the  runway  and  aiding 
symbology  would  enhance  the  llot's  management  of  the  vehicle  for 
both  automatic  a  id  manual  flight  control  (reference  3). 


An  experimental  display  was  derived  and  constructed  for  evaluation 
in  simulated  >pace  Shuttle  approach  and  landings.  It  was  intended  that 
data  obtained  would  support  the  contention  that  pilots  require  display 
support  not  currently  available  in  conventional  flight  instrumentation 
for  more  accurate  approach  management.  In  the  present  study,  the 
focus  of  display  aid  to  manual  flight  path  regulation  begins  with  a 
simplified  head-up  display  and  advances  to  a  higher  degree  of  display 
aid  represented  by  a  more  sophisticated  head-up  and  head-down  version. 
The  inherent  display  evaluation  problem,  when  it  comes  to  attempt  to 
distinguish  advantages  of  one  display  over  another  display,  is  one  of 
performance  measurement  techniques.  Many  times,  the  results  are 
limited,  inconclusive,  insensitive  or  even  contradictory.  Therefore, 
in  order  to  help  preclude  any  potential  conflicts  arising  from  inter¬ 
preting  insensitive  data  and  its  use  to  justify  the  advantages  or  merits 
for  any  of  the  above  display  concepts,  an  attempt  was  made  to  supple¬ 
ment  the  usual  landing  performance  data  with  human  operator  describing 
function  measurements. 

The  technique  to  be  described  was  an  attempt  to  measure  a  single 
longitudinal  outer  loop  of  the  Space  Shuttle  vehicle  during  terminal  area 
maneuvers.  It  represents  and  extension  of  human  operator  describing 
functions  to  a  demanding  and  realistic  task.  Previous  attempts  have 
been  made  to  measure  multiloop  pilot  describing  functions  during  instru¬ 
ment  approaches  in  a  simulation  of  a  large  subsonic  aircraft  (reference 
5);  however,  after  a  lengthy  computational  analysis,  the  results  showed 
inconclusive  multiloop  describing  function  variations  between  two  dis¬ 
similar  pilot  techniques.  For  this  reason  the  present  attempt  was 
limited  to  measuring  a  single  outer  loop  describing  function.  The  objec¬ 
tives  of  this  experiment  were:  (1)  to  test  the  validity  and  emphasize 
the  feasibility  of  generating  describing  functions  for  on-line  display 
evaluation  while  the  pilot  was  seated  in  the  simulator,  (2)  plot  the 
describing  function  data  and  other  terminal,  performance  measures  for 
similar  trends  among  pilots  and  test  for  repeatable  display  effects, 
and  (3)  use  the  results  to  indicate  where  dippiay  improvement  would  be 
desirable. 


System  Simulation 


Vehicle  Simulation.  A  sophisticated  six  degree-of-freedom  simula¬ 
tion  of  the  North  American  Rockwell  134-C  High  Cross  Range  Orbiter 
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was  programmed  on  a  hybrid  analog-digital  computer  facility  with 
options  for  either  manual  or  automatic  control  (reference  6).  A 
stability  augmentation  system  (SAS)  was  also  incorporated.  A  block 
diagram  of  the  longitudinal  airframe  including  SAS  compensation  func¬ 
tions  is  depicted  in  figure  1.  The  basic  airframe  equations  without 
SAS  are  complicated  by  the  unpowered  deceleration  descent  schedule 
which  continually  bleeds-off  the  final  approach  velocity.  Following 
are  two  representative  closed  loop  transfer  functions  with  SAS  augmen¬ 
tation  of  flight  path  angle  (y)  to  control  column  ( 6C)  taken  at  altitudes 
of  (1)  10,000  and  (2)  300  feet,  respectively,  and  are  plotted  in  figure  2. 
Selection  of  the  transfer  function  y  /6C  was  based  upon  the  nature  of  the 
flight  path  regulation  task  features  incorporated  into  the  display  and  is 
to  be  used  later  for  calculating  the  open  loop  describing  functions. 
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The  SAS  augmentation  (reference  5)  coupled  around  the  basic  airframe 
transfer  function,  requires  pitch  feedback  and  control  column  feed  for¬ 
ward  commands  which  are  necessary  to  generate  a  satisfying  respond¬ 
ing  vehicle.  As  can  be  seen  from  figure  2,  the  response  is  almost  iden¬ 
tical  over  the  high  and  low  altitudes. 

Disturbance  Input.  The  disturbance  input  (y<j)  was  the  sum  of  seven 
sinusoids  with  a  -20  db  high  frequency  shelf  at  3.  927  rad/sec  and  ap¬ 
plied  as  shown  in  figure  1.  The  spectral  input  frequencies  were  located 
at.  078,  .393,  .785,  1.257,  1.963,  3.927,  7.  854  rad/sec  and  the 
respective  amplitudes  at  each  frequency  were  1. ,  -1. ,  .6,  -.  38,  .  17, 

-.  1,  .1  degrees.  The  composite  sum  had  a  root  mean  square  (RMS) 
amplitude  of  1. 78  degrees. 

Describing  Rinctlon  Loop  Selection.  Selection  of  the  inner  loop 
pitch  was  not  considered  for  analysis  because  this  parameter  was 
highly  non-stationary  in  view  of  a  constantly  changing  angle  of  attack 
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attributed  to  a  decreasing  velocity  profile  peculiar  to  an  unpowered  ap¬ 
proach.  Because  of  the  nature  of  the  flight  path  regulation  display  task, 
a  middle  loop  or  flight  path  loop  was  selected.  A  modified  version  of 
the  Fast  Fourier  Transform  (FIT)  was  used  to  compute  pilot  (Yy) 
describing  functions,  including  remnant  spectra  (reference  7)  by 
measurements  of  the  ratio  of  control  column  ( 6  )  to  flight  path  orror 
(Ye) .  This  particular  version  allowed  the  computations  to  proceed  at 
a  greatly  reduced  time  than  that  normally  required  to  calculate  the 
truncated  Fourier  transform  of  the  sampled  control  column  output  (6C). 
Based  upon  the  computed  pilot  describing  function  (Yy),  the  open  loop 
describing  function  (Yql)  was  defined  and  calculated  as: 


Display  Simulation.  Experimental  display  configurations  were 
generated  by  an  Evans  &  Sutherland  Line  Drawing  System  (LDS-2)  and 
displayed  on  the  cathode  ray  tube  (CRT)  installed  and  collimated  at  the 
pilot's  station.  Analog  signals  generated  by  the  vehicle  simulation 
were  sampled  30  times  per  second  by  the  Systems  Engineering  Labora¬ 
tories  digital  computer  (SEL  840)  and  transferred  to  the  LDS-2  under 
control  of  the  display  generation  program.  The  basic  perspective  com¬ 
putations  for  the  runway  image  and  ground  reference  display  elements 
were  executed  in  the  LDS-2.  The  experimental  display  configurations 
are  shown  in  figure  3  (a  and  b).  A  photograph  of  the  full  display  comple¬ 
ment  is  seen  in  figure  4.  The  entire  head-up  scene  was  later  presented 
on  the  head-down  panel  positioned  CRT.  For  the  head-down  presenta¬ 
tion,  a  closed  circuit  TV  runway  image,  obtained  from  the  Ames 
General  Precision  System  Visual  Flight  Attachment,  was  phased  in 
from  an  in-cloud  condition  through  the  windscreen  as  the  vehicle 
descended  below  300  feet  altitude. 


Experimental  Plan 


Ten  participating  pilots  were  briefed  on  the  project  activities  and 
experimental  task  and  completed  the  necessary  training,  experimental 
run  series  including  a  debriefing  session  in  a  single  6-8  hour  visit  to 
Ames  Research  Center.  This  was  a  collaborative  effort  between  Ames 
and  Biotechnology,  Inc.  to  conduct  off  nominal  approach  sequences 
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(reference  4).  Figure  5  shows  five  display  modes  and  approach  pro¬ 
files  presented  for  a  total  of  160  flights,  or  16  flights  per  pilot.  The 
ebcve  main  study,  which  utilized  all  ten  participating  pilots,  was 
aimed  at  an  examination  of  the  subject  display  concept  for  different 
flight  profiles  and  wind  configurations  outside  the  nominal  10  degree 
flight  path  approach.  For  purposes  of  the  describing  function  measure¬ 
ments,  only  display  modes  C-l,  C-4  and  C-5  were  retained  for  a 
nominal  10  degree  flight  path  profile.  Mode  C-5  was  presented  head- 
down  and  contained  identical  display  information.  Consequently  for 
the  purposes  of  this  paper  C-5  will  be  referred  to  as  C-4  head-down. 
Typically,  C-l  is  the  display  illustrated  in  figure  3-a,  and  C-4  and  C-4 
head-down  illustrated  in  figure  3-b.  Both  C-l  and  C-4  were  head-up 
display  presentations  viewed  through  the  windscreen. 

Four  of  the  ten  pilots  also  participated  in  the  present  experiment 
to  measure  their  describing  functions.  Each  of  the  four  pilots  com¬ 
pleted  his  training  and  16  required  display  mode-approach  profile 
flights  for  the  main  study  before  attempting  the  disturbance  input  flights. 
Injection  of  the  disturbance  input  as  shown  in  figure  1  was  interpreted 
to  resemole  gust  inputs.  For  these  flights,  each  of  the  four  pilots  was 
given  two  final  flights;  the  first  was  a  training  effort,  and  the  second 
for  best  effort.  Both  flights,  however,  had  describing  functions  cal¬ 
culated  to  investigate  similarities,  strategies  or  trend  effects  among 
pilots  and  display  modes.  Each  flight  was  segmented  as  indicated  in 
figure  6  because  it  was  anticipated  that  the  pilots  might  adopt  different 
strategies  or  techniques  when  transitioning  from  a  steep  10  degree  to 
shallow  2-1/2  degree  glide  slope.  Each  segment,  the  pre-transitional 
and  transitional  span,  was  divided  into  100  seconds.  Describing  func¬ 
tion  data  was  calculated  on  80  seconds  of  each  respective  segment.  A 
preview  period  of  about  one  minute  transpired  with  the  disturbance 
input  before  entering  the  first  transitional  segment.  Actual  transition 
from  10  to  2-1/2  degree  glide  slope  took  about  4  seconds  and  occurred 
about  midway  through  segment  2.  Completion  of  segment  2  occurred  at 
about  200  feet  altitude. 


Results  &  Discussion 


The  first  of  the  experimental  series  involved  an  interpretation  of 
the  displays  by  the  pilots  for  the  ground  oriented  perspective  features, 
and  the  techniques  used  to  adjust  the  glide  path.  Since  the  displays 
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contained  glide  slope  reference  symbology,  it  was  expected  that  the 
pilots  would  adjust  the  ground  referenced  aiming  point  by  regulating 
flight  path  angle. 

Landing  Performance  Measure  Results.  The  experimental  displays 
were  developed  to  support  flight  control  during  the  approach  to  the  land¬ 
ing  site,  but  not  the  final  landing  maneuver  and  touchdown  on  the  runway. 
Figure  7  shows  the  overall  RMS  glide  slope  error  ( ^  values  with 
the  disturbance  input  applied  over  both  approach  segments  1  &  2.  The 
only  retd  obvious  differences  occur  in  glide  slope  tracking  accuracy  for 
the  second  segment  (p  <  .  05).  A  significantly  tighter  standard  devia¬ 
tion  between  the  head-down  and  head-up  glide  slope  error  can  be 
observed  in  figure  7  for  the  second  segment.  The  means  of  these  dis¬ 
plays  are  also  observed  to  be  about  equal.  It  appears  from  this  data 
that  the  C-4  display  was  considerably  better  than  the  C-l  display.  Pro¬ 
viding  that  these  results  would  hold  up  for  more  pilots  it  would  be  use¬ 
ful  for  making  display  evaluations  that  C-4  indeed  was  better  than  C-l. 
This  data  will  be  correlated  with  describing  function  results  later  in  the 
paper.  Evidence  thus  far  based  on  the  above  RMS  performance  meas¬ 
ure  is  not  sufficient  to  make  sound  engineering  display  evaluations. 

Describing  Function  Results.  In  referring  back  to  figure  1,  there 
were  two  measurements  taken  on  both  the  pilots  control  column  output 
(<5C)  and  the  pilots  display.  These  measurements  were  used  to  generate 
the  pilot  transfer  function  (Yy).  As  pointed  out  earlier,  the  inner  loop 
pitch  was  considered  to  become  highly  non-stationary  and  hence  more 
difficult  to  examine;  whereas,  the  flight  path  loop  would  remain  more 
consistent  throughout  the  approach  maneuver  and  would  also  be  asso¬ 
ciated  closer  to  the  flight  path  regulation  tasks.  It  must  be  emphasized 
that  these  results  were  an  attempt  to  analyze  data  obtained  from  a  com¬ 
plex  unpowered  and  manually  controlled  vehicle.  The  environment  is 
that  essentially  of  a  demanding  and  realistic  task  in  a  non-linear  and 
non-stationary  final  approach  maneuver  from  a  steep  to  shallow  glide 
path. 

Pilot  Describing  Functions  (Yy) .  Figure  8  shows  the  effect  of 
increasing  display  aid  (C-l  to  C-4)  for  the  same  pilot  pair  (7  and  8).  It 
can  be  observed  for  C-4  that  a  gain  advantage  of  about  10  db  throughout 
both  segments  is  predominate  in  the  mid-high  frequency  regions.  The 
phase  over  the  first  segment  appears  to  have  a  higher  phase  lead  with 
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C-4  at  the  low  frequency  spectrum.  The  phase  over  the  second  segment 
has  consistently  higher  phase  lead  over  most  of  the  spectrum.  In 
general,  the  first  segment  shows  a  substantial  phase  lead  for  both  dis¬ 
plays,  but  more  uniform  for  C-4. 

As  a  comparison,  figure  9  shows  that  the  second  pilot  pair  (9  and 
10),  who  flew  the  same  C-4  display,  maintained  very  good  gain  and 
phase  relationship  as  well  as  good  behavioral  correlation  to  the  first 
pilot  pair  (7  and  8)  results.  Definite  phase  peaking  consistently  appears 
throughout  each  second  segment  display  mode  at  about .  78  rad/sec. 

Figure  9  also  shows  the  results  of  the  head-down  panel  mounted  C-4 
display  mode.  Although  the  pilots  reacted  in  a  manner  very  similar  to 
the  previous  C-4  head-up  display  there  is  some  evidence  of  higher  gain 
and  phase  lead  over  the  low  frequency  spectrum  for  both  segments  of 
the  head-down  display  application. 

Open  Loop  Describing  Function  (Yql,).  The  open  loop 
describing  function  was  determined  analytically  based  upon  the 
measured  pilot  describing  function  and  the  results  of  the  V/ 6C  transfer 
function  presented  in  figure  2.  As  can  be  seen  from  figure  2,  Y/6C 
or  Yc  varies  very  little  from  the  high  altitude  segment  1  to  low  altitude 
segment  2  because  of  the  stability  augmentation  system  (SAS)  compensa¬ 
tion.  Therefore,  the  results  of  the  open  loop  describing  function  and 
their  respective  crossover  frequencies  are  considered  valid  estimates. 
Figure  10  shows  the  effect  of  increasing  display  aid  (C-l  to  C-4)  for  the 
same  pilot  pair  (7  &  8).  For  the  first  and  second  segments  it  is  ob¬ 
served  that  the  C-4  display  has  higher  gain  and  more  phase  lead.  The 
crossover  frequencies  are  about .  6  to  .  7  rad/sec  for  both  C-l  display 
segments,  but  move  to  around  1. 75  rad/sec  for  each  of  the  C-4  seg¬ 
ments.  Phase  margin  for  the  C-l  display  is  about  20  degrees  lower 
over  segment  2  than  that  obtained  for  the  C-4  display. 

Also  of  interest  and  comparison,  figure  11  shows  the  results  of  the 
same  C-4  display  for  the  second  pilot  pair  (9  &  10).  Their  crossover 
frequencies  seem  to  be  higher  over  the  first  segment  (1. 1  -  2  rad/sec) 
compared  to  the  range  (.  82  -  1.  5  rad/r  o)  over  the  second  segment. 

Also  the  pilots  appear  to  be  operating  at  a  lower  gain  over  the  first 
segment.  Good  behavioral  correlation  between  these  pilots  can  also  be 
observed.  As  seen  with  the  other  pilots  and  display  configurations, 
there  is  a  noticeable  difference  in  phase  angle  between  segment  1  and  2. 
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Probably  one  of  the  most  important  comparisons  is  that  between 
head-up  and  head-down  displays.  Figure  11  also  shows  the  open  loop 
describing  function  for  the  head-down  display  mode  for  the  same  pilot 
pair  (y  &  10),  and  should  be  compared  with  the  C-4  head-up  version 
results  seen  in  the  same  figure.  For  C-4  head-down  the  first  segment 
gain  was  higher  by  about  10  db  around  .  39  rad/sec.  This  should  be 
considered  potentially  important  because  pilots  like  to  fly  low  gain  when 
possible.  Such  is  the  case  for  the  C-4  head-up  display  segment  1  where 
the  gain  appears  to  be  low.  The  higher  gain  observed  over  the  first 
segment  for  C-4  head -down  is  not  too  unlike  that  obtained  over  the 
second  segment  and  indicates  that  about  equal  efforts  are  applied.  Other 
than  this,  the  only  remaining  feature  is  a  slight  higher  shift  in  cross¬ 
over  frequency  for  the  second  segment  C-4  head-down  display.  Phase 
and  phase  margin  are  about  equal. 

Pilot  Workload  Estimates 

For  the  first  segment,  figure  12a  shows  that  pilots  who  flew  C-l 
and  progressed  to  fly  C-4,  showed  an  increase  in  crossover  frequency. 
Over  the  same  segment,  pilots  who  flew  C-4  head-down  and  progressed 
to  fly  C-4  head-up  likewise  increased  their  crossover  frequency.  An 
average  estimate  of  crossover  frequency  appears  to  be  about  1.  4  rad/ 
sec. 


For  the  second  segment,  figure  12b  shows  that  pilots  who  flew  the 
C-l  display  and  progressed  to  fly  C-4,  showed  an  increase  in  cross¬ 
over  frequency.  Pilots  who  flew  C-4  head-down  and  progressed  to  C-4 
head-up  experienced  a  decrease  in  crossover  frequency.  Across  the 
second  segment,  an  overall  average  estimate  of  crossover  frequency 
also  appears  to  be  around  1. 4  rad/sec  and  similar  to  the  first  segment. 

As  another  measure  of  how  hard  the  pilots  worked,  figure  13  shows 
the  ratio  of  control  column  (6§)  output  to  the  input  distrubance  (yg) 
across  both  segments  for  each  of  the  three  display  configurations.  It 
can  be  observed  that  the  pilot's  output  for  the  first  segment  was  sub¬ 
stantially  less  than  that  for  the  second  segment  by  about  a  factor  of  two. 
In  either  case,  however,  there  appears  to  be  an  obvious  difference  in 
display  aid  between  the  C-l  and  C-4  head-up  displays,  but  with  little 
evidence  to  support  major  differences  between  head-up  or  head-down 
displays.  Further  examination  shows  a  10-15%  decrease  in  the  pilot's 
control  column  spectral  output  to  input  ratio  for  the  second  segment 
C-4  head-down  version  compared  to  C-4  head-up  which  is  the  only 
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obvious  trend.  This  trend  toward  the  lower  control  column  spectral 
output  to  Input  ratio  for  the  C-4  head-down  display  may  also  be  asso¬ 
ciated  with  the  smaller  glide  slope  deviation,  which  is  half  that  observed 
for  C-4,  although  the  mean  errors  are  essentially  equal.  Because 
changes  in  control  column  output  ultimately  result  in  glide  path  varia¬ 
tions,  a  correlation  with  the  effect  upon  glide  slope  error  and  their 
association  with  crossover  frequency  is  suggested.  Therefore,  from 
figures  7  and  13,  it  can  be  seen  that  pilots  who  flew  the  C-4  displays 
had  about  equal  glide  slope  errors  and  control  column  Input/output 
spectral  ratios.  Further  examination  suggests  Investigating  a  tripartite 
correlation  between  normalized  crossover  frequency,  glide  slope  error, 
and  control  column  to  input  disturbance  spectral  ratio  as  seen  in  figures 
14  and  15.  This  data  was  normalized  from  figures  7  and  13  for  both 
segments.  It  appears  that  the  higher  crossover  frequencies  are  related 
to  more  accurate  glide  slope  tracking  as  reflected  by  an  increase  in 
the  pilot's  output  power  through  his  control  column.  This  appears 
generally  across  both  segments  for  pilots  transitioning  from  low  dis¬ 
play  aid  (C-l)  to  increased  display  aid  (C-4).  Figure  15  shows  that 
pilots  transitioning  from  head- down  to  head-up  display  aid  for  the 
second  segment,  crossover  frequency  decreases  and  flight  path  error 
and  control  column  output  power  increases.  The  exception  occurred 
for  pilot  9  over  the  first  segment  where  crossover  frequency  increased 
rather  than  decreased.  Because  the  second  segment  encompasses  the 
transition  from  high  to  low  approach  glide  slope,  more  emphasis  should 
be  placed  on  the  second  segment  as  the  more  critical  maneuver  area. 

It  should  be  emphasized  at  this  point  that  all  the  pilot  describing  func¬ 
tions  over  the  second  segment  (figures  8  &  9)  show  more  dramatic 
phase  changes  whereas  the  gain  was  more  uniform  for  either  segment. 
Therefore,  considering  the  second  segment,  it  appears  that  the  pilots 
were  more  consistent  and  performed  better  with  the  C-4  head-down  dis¬ 
play.  There  is  an  explanation  why  the  pilots  verbally  expressed  a 
preference  and  more  confidence  with  the  C-4  head-up  display,  even 
though  this  conflicted  with  the  measured  data.  One  explanation  stands 
out.  That  for  displays  presented  in  true  or  in  real  world  perspective 
and  viewed  through  the  windscreens,  the  pilot  is  allowed  to  identify  and 
orient  himself  subconsciously  in  space,  whereas  when  compressing  the 
display  for  head-down  operations,  the  pilot  may  loose  his  ability  to 
identify  his  true  position  relative  to  real  world  space.  Consequently, 
he  tries  to  compensate  through  inflated  work  efforts  as  reflected  through 
his  control  column  output  strategies  and  the  resultant  effect  upon  glide 
slope  errors. 
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Conclusions 


The  literature  of  describing  function  measurements  aimed  toward 
the  evaluation  of  complex  flight  displays  is  very  limited.  Of  current 
interest  is  the  development  of  landing  aid  displays  to  assist  the  pilot 
for  an  unpowered  Space  Shuttle  final  approach  maneuver.  Conventional 
landing  performance  data  taken  during  the  approach  and  landing,  gen¬ 
erally  need  more  powerful  measurement  techniques  in  order  to  make 
a  responsible  decision  in  terms  of  assessing  display  aid  to  the  pilot. 
Describing  function  measurements  can  be  used  to  provide  a  support 
measure  for  other  performance  data.  Use  of  a  modified  Fast  Fourier 
transform  was  integrated  into  the  display  program  to  investigate  the 
pictorial  display  concepts  designed  for  increasing  display  aid  to  the 
pilot.  Three  displays  were  evaluated  by  four  pilots  for  either  a  head-up 
or  head-down  display  operating  throughout  a  simulated  unpowered  final 
approach  maneuver. 

Among  the  display  features  were  accentuated  ground  referenced 
pre-flare  and  runway  positioned  aiming  point  references  and  velocity 
vector  information  for  flight  path  alignment.  The  primary  task  was 
one  of  flight  path  regulation.  As  determined  from  performance  criteria 
and  both  pilot  and  open  loop  describing  functions,  the  pilots'  ability  or 
strategies  varied  between  the  pie-transitional  and  transitional  segmental 
phases  of  the  flight  maneuver.  Marked  differences  occurred  between 
the  simplified  and  the  more  sophisticated  display  aid  through  both  seg¬ 
ments.  According  to  the  pilot  describing  function  analysis,  the  more 
sophisticated  display  aid  was  favored.  For  the  open  loop  describing 
function  analysis,  the  crossover  frequencies  tend  to  increase  for  the 
more  advanced  display  aid  over  both  approach  segments.  Comparing 
head-up  to  head-down  displays,  the  crossover  frequencies  are  equal 
over  the  first  segment  and  tend  to  increase  slightly  for  the  head-down 
display  over  the  second  segment. 

Larger  glide-slope  errors  occurred  over  the  first  pre-transitional 
segment  and  were  reduced  over  the  second  segment.  A  tripartite  corre¬ 
lation  between  crossover  frequency,  glide-slope  error,  and  ratio  of 
control  column  power  to  input  disturbance  indicates  that  lower  glide  slope 
errors  are  related  to  higher  crossover  frequencies  and  higher  control  column 
activity.  The  pilots  tended  to  relax  more  and  preferred  the  head-up 
displays.  The  performance  relative  to  crossover  frequency,  glide 
slope  error  and  control  column  power  over  the  first  pre-transitional 
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segment  was  about  evenly  divided  between  the  head-up  and  head-down 
displays.  During  the  second  more  critical  transitional  segment  it 
appears  that  the  pilot’s  performance  was  better  for  the  head-down 
operations.  One  possible  explanation  is  that  the  pilots  tend  to  loose 
their  space  orientation  and  true  world  perspective  when  the  entire  head- 
up  version  is  compressed  to  a  small  panel  representation.  The  reaction 
among  the  pilots  was  that  the  head-down  display  required  more  con¬ 
certed  efforts  to  achieve  satisfactory  performance  compared  to  the 
head-up  display.  From  the  results  of  the  measured  pilot  transfer  func¬ 
tion  and  the  technique  of  analyzing  a  flight  path  loop,  the  data  obtained 
appear  to  be  consistent  and  repeatable.  These  results  are  obtained  in 
a  very  complex  environment  whereby  the  describing  function  approach 
can  be  applied  to  a  complex  time  varying  task  such  as  that  demonstrated 
by  the  Space  Shuttle  final  approach  maneuver.  Although  one  cannot 
easily  surmise  the  psychological  impact  of  pilot  display  preference  or 
confidence  and  its  possible  conflict  with  other  types  of  performance 
data,  it  is  felt  that  the  above  extrapolation  of  these  data  obtained  through 
describing  function  measurements  lend  more  support  in  predicting  dis¬ 
play  evaluation  for  Space  Shuttle  operations.  A  thorough  and  sound 
engineering  evaluation  of  other  advanced  display  concepts  could  be  ap¬ 
proached  by  this  technique  providing  that  a  good  experimental  design 
with  sufficient  replications  and  pilots  are  included. 
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Figure  1.-  Block  Diagram  of  Longitudinal  Airframe  with  Manual  Stability 
Augmentation  System  (SAS)  on  and  Disturbance  Input. 
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Figure  6.-  Final  Approach  Geometry  with  Pre-flare 
Runway  Aiming  Point  Symbology. 
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Figure  8.-  Pilot  Describing  Function  for  C-l  and  C-4  Display  Mode 


PILOT  9 


Figure  9.-  Pilot  Describing  Function  for  C-4  and  C-4  Head-down 

Display  Mode. 


Figure  10.-  Open  Loop  Describing  Function  for  C-l  and  C-4  Display  Mode 


PILOT  9  C-4 


Figure  11.-  Open  Loop  Describing  Function  for  C-4  and  C-4  Head-down 

Display  Mode. 
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Figure  13.-  Relationship  of  Pilot's  Control  Column  Output  to  Input 
Disturbance  as  a  Function  of  Displays. 


Figure  14.-  First  Segment  Total  Correlated  Crossover  Frequency,  Glide  Slope 
Error  and  Ratio  of  Control  Column  to  Input  Disturbance  Versus  Displays. 


PAPER  PILOT  HOVERS  LATERALLY 


David  L.  Nolting*,  James  D.  Dillow,  Russell  A.  Hannen 

SUMMARY  no!'  > 


Data  was  obtained  from  a  fixed  base  simulation  of  VTOL 
aircraft  in  the  lateral  hover  mode  and  used  to  develope  a 
technique  for  predicting  lateral  hover  flying  qualities.  The 
task  for  the  simulation  was  to  maintain  position  in  the  presence 
of  lateral  gusts.  Root-mean-square  aircraft  state  and  pilot 
input  data  were  obtained  and  correlated  with  Cooper-Harper 
Pilot  Ratings.  A  mathematical  model  for  predicting  the  pilot 
rating  of  VTOL  aircraft  in  lateral  hover  is  developed.  This 
model  includes:  (1)  the  lateral  hover  aircraft  equations  ox' 
motion;  (2)  a  stochastic  gust  model;  (3)  a  linear  pilot  model; 
and  (4)  a  pilot  rating  expression  that  is  a  function  of  rms 
position  error,  rms  lateral  velocity,  rms  roll  rate,  and  pilot 
lead  terms.  Pilot  gains  and  lead  time  constants  are  chosen  to 
minimize  the  pilot  rating.  Predicted  and  actual  pilot  ratings 
and  performance  are  compared  for  the  fixed  base  simulation  data. 
The  differences  between  predicted  and  actual  pilot  ratings  have 
a  mean  of  0.11  rating  units  and  a  standard  deviation  of  0.24 
rating  units  on  a  10  point  scale.  Predicted  and  actual  pilot 
ratings  are  compared  for  131  additional  aircraft  configura¬ 
tions  with  differences  less  than  t  1 .0  rating  unit  for  82.4% 
of  the  cases. 


INTRODUCTION 


The  paper  pilot  concept  for  predicting  aircraft  handling 
qualities  in  a  specified  piloted  task  is  based  on  the  following 
hypothesis . 

1.  For  a  well  defined  task,  the  pilot  rating  is  a  func¬ 
tion  of  the  closed  loop  performance  and  the  pilot  workload. 

This  function  is  called  the  pilot  rating  expression. 

2.  The  predicted  pilot  rating  can  be  obtained  by  mini¬ 
mizing  the  pilot  rating  expression  with  respect  to  free  pilot 
parameters  in  the  closed  loop  pilot-vehicle  model.  (The  lower 
the  rating--the  better  the  handling  qualities.)  The  minimal 
value  of  the  pilot  rating  expression  corresponds  to  the  pilot 
rating  for  the  task. 

The  paper  pilot  concept  has  been  demonstrated  in  the  past 
for  various  tasks  including  longitudinal  hover,  pitch  tracking, 
roll  attitude,  and  heading  tasks  (Refs  1  through  5).  In  this 
study  the  paper  pilot  concept  is  applied  to  the  task  of  main¬ 
taining  a  fixed  position  over  the  ground  in  a  vertical  take  off 
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and  landing  (VTOL)  type  aircraft.  Lateral  disturbances  are 
introduced  in  the  form  of  a  side  turbulence.  Longitudinal 
notion  was  not  considered. 

In  this  paper  the  simulation  study  used  to  collect 
performance  data  and  pilot  ratings  is  briefly  described. 

This  data  was  used  to  develop  a  pilot  rating  expression  which 
is  a  function  of  the  rms  lateral  hover  error,  rms  roll  rate, 
rms  side  slip,  and  two  pilot  leads  in  the  pilot  model.  Pre¬ 
dicted  pilot  ratings  are  computed  by  selecting  four  free 
parameters  in  the  pilot  model  so  as  to  minimize  the  pilot 
rating  expression.  These  results  are  compared  to  the  actual 
pilot  ratings  obtained  from  the  simulation.  This  method  of 
predicting  pilot  rating  was  also  used  for  151  other  configura¬ 
tions  for  which  pilot  rating  data  was  available.  The  predicted 
pilot  ratings  are  compared  to  actual  ratings  for  these  cases, 
Details  of  this  paper  are  contained  in  Ref  6. 

SIMULATION 


A  fixed  base  simulation  was  used  to  collect  data  on  the 
lateral  hover  task.  The  simulation  was  conducted  at  the 
Flight  Control  Division  of  the  Air  Force  Flight  Dynamics 
Laboratory,  Wright-Patterson  Air  Force  Base,  Ohio. 


The  equations  of  motion  for  roll  and  lateral  displacement 
for  hover  are  taken  from  Ref  7.  These  equations  assume  small 
perturbations  from  hovering  flight.  The  general  form  of  the 
linearized  lateral  equations,  assuming  lateral  translations 
can  be  affected  only  through  roll,  are 


y  ■  v 

v  ■  Y  v  ♦  ^  ♦  Y  v 

v  57 .3  v  g 

♦  ■  P 

p  ■  57.3  L  v  ♦  L,$  ♦  L  p  ♦  L.  { .♦  57.3  L  v 
v  f P  5  a  V  g 


where  y  is  lateral  displacement,  v  is  lateral  velocity,  $  is 
roll  angle,  p  is  roll  rate,  6  is  effective  control  input,  6  is 

commanded  control  input,  T  is  the  control  lag  time  constant, 

ft 

and  Vg  is  turbulence  velocity  in  the  v  direction.  All  angles 
are  in  degrees.  Displacement,  y,  is  in  ft  and  v  and  v^  are  in 
ft/sec. 
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The  turbulence  was  simulated  by  passing  a  white  Gaussian 
random  process  through  a  first  order  filter  with  a  break 
frequency  of  0.314  rad/sec.  This  is  a  first  order  approxima¬ 
tion  to  the  Dryden  gust  model  (Ref  8)  and  is  the  gust  model 
used  in  Ref  7.  An  rms  turbulence  level  of  5.1  ft/sec  was 
used,  consistent  with  Ref  7. 


The  task  in  this  experiment  was  to  maintain  a  fixed  posi¬ 
tion  relative  to  a  reference  line  in  the  presence  of  turbulenc< 

m  «  I  _  t  •  •  A  .  A  1  «  .  A  «  - '  A  J  _  n  ^  ^ 


l  x  vii  rci  alive  l  sj  a  i  cuwt  xauc  in  uic  ovutc  vx  t  ui  uui  tuuv 

This  task  is  similar  to  the  lateral  hover  experiment  in  Ref  7, 
except  that  no  longitudinal  motion  was  simulated  for  this  study 
A  side  force  stick  with  a  USAF  fighter-type  grip  was  used  for 
pilot  inputs  to  the  system.  The  stick  sensitivity  was  selected 
by  each  pilot  to  give  the  preferred  roll  acceleration  per  pound 
input  for  a  given  configuration.  Aircraft  roll  altitude  and 
lateral  displacement  were  displayed  on  a  dual  beam  oscillo¬ 
scope.  The  scope  was  placed  level  with  and  approximately 
20  inches  from  the  pilots  eyes.  The  scope  display  is  shown 
in  Fig.  1.  A  vertical  line  indicated  actual  position.  As 


Fig.  1.  Roll  and  Lateral  Position  Display 
with  Desired  Position  and  Disturbed  Position. 


viewed  by  the  pilot,  the  movement  of  the  verti 
ponded  to  the  apparent  movement  of  a  vertical 
approximately  200  feet  in  front  of  the  pilot, 
displayed  by  a  rotating  "horizon"  line.  This 
about  the  center  of  the  display.  One  degree  o 
equaled  one  degree  of  simulated  aircraft  roll, 
were  selected  from  Ref  7  for  the  simulation, 
selected  to  give  a  wide  range  of  pilot  rating 
between  3.0  to  4.0.  An  attempt  was  also  made 


cal  line  corres 
pole  located 
Roll  angle  was 
line  rotated 
f  indicate^  rol 
Fifteen  cases 
The  cases  were 
with  8  cases 
to  include  a 
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wide  range  of  different  stability  derivatives  which  are 
indicative  of  a  diverse  set  of  flight  conditions. 


Four  military  pilots  participated  in  the  experiment. 

Two  of  the  pilots  had  helicopter  experience;  however,  heli¬ 
copter  experience  was  not  a  significant  factor  in  this  task. 
Each  pilot  was  thoroughly  trained  with  *ach  configuration  be¬ 
fore  data  was  taken.  The  Cooper-Harper  rating  scale  was  used 
to  obtain  numerical  pilot  ratings  (Ref  8). 


The  pilot  ratings  from  this  simulation  are  compared  with 
those  obtained  from  Ref  7  in  Fig.  2.  The  most  important 
differences  in  pilot  rating  come  basically  from  two  sources. 
First,  Miller  and  Yinje  used  the  Harper  scale  (Ref  7)  and  this 
simulation  used  the  revised  Cooper-Harper  scale  (Ref  8)  . 
Second,  Miller  and  Vinje  used  a  sophisticated  contact  analog 
display  system  to  indicate  aircraft  position  and  altitude. 

The  display  sensitivity  provided  information  comparable  to 
actual  low  altitude  hovering  flight.  The  oscilloscope  display 
used  in  this  experiment  provided  information  comparable  to 
hovering  on  instruments.  This  is  a  much  more  difficult  task. 


The  data  indicated  that  different  pilot  techniques  do  not 
significantly  change  the  pilot  ratings.  Pilot  DB  worked  harder 
and  maintained  smaller  hover  error  in  most  cases  than  did  pilot 
EL.  Pilot  EL  did  not  work  as  hard  and  accepted  larger  hover 
error.  However,  their  pilot  ratings  do  not  differ  significantly 


bo 

C 


o i 


Cl. 

a 

o 

•H 


3 

B 

•H 


Pilot  Rating  from  Ref  7 


Fig.  2.  Comparison  of  Simulation  and 
Miller-Vinje  Pilot  Ratings. 
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for  the  15  cases  flown.  This  tends  to  support  the  theory  that 
pilot  rating  is  a  sum  of  a  measure  of  workload  and  a  measure 
of  performance  as  postulated  by  Anderson  (Ref  1) . 

PAPER  PILOT 

An  analytic  model  of  the  closed  loop  pilot  vehicle  system 
was  used  to  predict  pilot  rating  and  system  performance. 

The  pilot  model  used  is  the  fixed  form  model  shown  in 
Fig.  3.  K  and  K  are  pilot  gains,  T  and  TL  are  pilot 
Py  p$  y  ♦ 

leads,  T.  and  T_  are  pilot  lags,  and  e"TS  is  a  pure  time 

y  ♦ 


Fig.  3.  Fixed  Form  Pilot  Model. 

delay.  The  y  and  $  subscripts  indicate  the  position  and  roll 
loops  respectively.  Various  values  for  the  lag  and  time  delay 
terms  were  examined.  The  final  values  selected  give  the  best 
performance  match  between  the  simulation  and  digital  computer 
results.  These  values  are  x  ■  0.4  sec,  Tj  *  0.05  sec,  and 

y 

T  ■  0.15  sec.  K  ,  K  ,  T.  ,  and  T.  are  considered  as 

py  p$  Ly 

free  parameters  in  the  optimization  procedure  described  below. 

The  predicted  pilot  rating  and  performance  is  obtained  in 
the  following  manner.  The  four  free  pilot  parameters  are 
selected  to  minimize  the  pilot  rating  expression  given  by 

PR  =  PERF  +  .26  T.  +  1.25  T.  +  1.0 

Ly  L0 
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where 


and 


PERF  - 


{TPERF  ,  TPERF  <  5.0 

*.  (TPERF  ♦  5.0),  TPERF  >  5.0 


TPERF  ■  .3  (J  ♦  .34  o  ♦  .48  o 
y  v  p 

As  in  the  simulation,  a  rms  gust  disturbance  velocity,  o  , 

Vg 

of  5.1  ft/sec  was  used.  The  resulting  minimum  value  of  PR  is 
the  paper  pilot  rating. 

The  expression  for  PERF  in  the  pilot  rating  expression 
reflects  the  assumption  that  once  rms  performance  exceeds  a 
certain  level,  any  further  degradation  in  performance  is  not 
rated  as  heavily  by  the  pilot.  The  weightings  on  the  pilot 
lead  terms  and  the  weightings  on  the  rms  values  of  y,  p,  and  t 
in  the  pilot  rating  expression  were  determined  by  an  iterative 
procedure  described  in  Ref  6.  This  iterative  procedure  uses 
the  data  obtained  in  the  simulation  to  derive  the  set  of 
weightings.  The  predicted  values  for  pilot  rating  and  per¬ 
formance  agree  well  with  the  data  from  the  simulation.  The 
scatter  diagrams  comparing  predicted  and  simulated  pilot  rating 
and  performance  are  shown  in  Figs.  4  through  9.  The  difference 
between  pilot  ratings  from  the  minimization  technique  and  the 
simulation  is  less  than  0.5  in  all  but  one  case. 

The  predicted  rms  performance  values  also  compare  quite 

well  with  the  results  from  the  simulation.  There  is  a  tendency 

for  predicted  rms  performance  to  be  lower  than  actual  rms 

performance  values.  This  is  especially  true  for  pilot  input, 

6  .  Roll  and  roll  rate  are  also  somewhat  low.  This  could 
a 

possibly  be  explained  by  the  absence  of  pilot  remnant  in  the 
pilot  model.  Since  pilot  remnant  adds  uncertainty,  it  would 
tend  to  increase  the  predicted  rms  performance.  Thus  the 
addition  of  remnant  in  the  pilot  model  would  cause  a  closer 
match  between  the  predicted  and  simulation  rms  performance 
values . 


TESTING  PAPER  PILOT 

If  the  "paper  pilot"  concept  is  valid,  the  minimization 
routine  should  accurately  predict  pilot  ratings  for  configura¬ 
tions  that  were  not  used  in  the  development  of  the  pilot  rating 
expression.  Miller  and  Vinje  (Ref  7)  tested  166  lateral  hover 
configurations.  Fifteen  of  these  cases  were  used  in  this  study 
to  develop  the  pilot  rating  expression.  Of  the  remaining  cases, 
20  could  not  be  used  because  they  were  tested  in  Ref  7  without 
a  gust  input.  The  remaining  131  cases  were  used  to  test  the 
ability  of  the  paper  pilot  scheme  to  accurately  predicted  pilot 
ratings . 
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*n  f *he  pilot  ratings  fron  Ref  7  are  compared  with 
those  taken  from  the  simulation  described  in  this  report.  There 
is  not  exact  agreement  and  the  actual  pilot  ratings  from  this 
simulation  are  generally  higher  than  those  from  Ref  7.  As  was 
mentioned,  the  visual  display  used  in  the  simulation  of  Ref  7 
was  superior  to  the  one  used  in  this  simulation  and  different 
rating  scales  were  used.  An  aircraft  rated  on  a  Cooper-Harper 
scale  would  tend  to  have  a  higher  rating  than  if  it  were  rated 
on  a  Cooper  scale.  There  are  also  other  instances  where  con¬ 
figurations  from  Ref  7  have  been  used  in  an  independent  simula¬ 
tion  and  the  pilot  ratings  have  tended  to  be  higher  than  those 
given  in  Ref  7  (Refs  9,  10).  Thus  it  was  decided  to  modify 
the  pilot  rating  of  Ref  7  to  give  paper  pilot  a  fair  shake. 

shown  in  Fig.  2  was  used  to  determine  the  best 
linear  fit  (in  a  least  squares  sense)  between  the  actual  pilot 
ratings  of  this  simulation  and  those  of  Ref  7.  It  was  found 
that  multiplying  the  pilot  ratings  from  Ref  7  by  a  factor  of 
1.23  resulted  in  the  closest  match  between  the  two  sets  of 
actual  ratings  for  these  IS  cases. 

The  predict sd  pilot  ratings  are  compared  with  the  Ref  7 
pilot  ratings  multiplied  by  this  factor  for  the  remaining 
131  cases.  The  results  of  the  131  cases  are  shown  in  Fig.  io. 
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Fig.  10.  Predicted  Pilot  Rating  vs. 
Miller-Vinje  Pilot  Ratings  (x  1,23). 
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The  predicted  pilot  rating  is  within  ♦  1.0  of  the  actual  for 
82.4%  of  the  cases.  It  is  within  ♦  l.S  for  97.7%  of  the  cases 
and  is  always  within  ♦  2.0.  This  Is  excellent  agreement  con¬ 
sidering  both  the  differences  in  the  simulations  and  the  fact 
that  different  pilot  rating  scales  were  used. 

The  accuracy  of  the  predicted  pilot  ratings  compares 
favorably  with  the  accuracy  of  the  actual  pilot  rating  given 
by  a  pilot  on  a  single  flight.  An  analysis  of  the  simulation 
data  indicates  that  single  run  pilot  ratings  are  within  t  1.0 
of  the  case  average  for  only  81.4%  of  the  runs. 

YOU  DONE  GOOD,  PAPER  PILOT! 
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ABSTRACT 

The  model  of  Miller  and  Vinje  is  arranged  as  a  state-feedback 
model  with  the  adjustable  pilot  parameters  represented  by  adjustable 
feedback  gains.  The  system  is  then  regarded  as  a  sub-optimal  control 
system  to  permit  rapid  derivation  of  unknown  parameters.  Results 
for  the  Inverse  optimal  control  problem  are  presented,  and  the 
model  is  used  to  design  and  compare  compensators  for  the  complete 
man-machine  system. 
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1. 


TOE  PILOT-VTOL  AIRCRAFT  SYSTEM 


The  modelling  of  human  response  in  controlling  a  hovering  V.T.O.L. 
aircraft,  has  received  considerable  attention  in  recent  years.  In  the  true 
engineering  sense,  the  human  controls  a  vehicle  of  basically  unstable  dynamics 
in  the  presence  of  some  disturbance.  His  control  actions  are  b^aed  upon 
observations  of  the  various  states  of  the  vehicle. 

The  model  and  results  of  Miller  and  Vinje  [I]  are  often  quoted,  and 
have  been  used  in  the  project  described  herein.  Applicable  to  the  longitudinal 
control  of  a  simulated  Sikorsky  S— 61  helicopter,  their  model  is  shown  in 
Figure  I.  The  models  for  the  aircraft  and  pilot  are  given  in  equations  (1)  and 
(2)  respectively. 
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Regarding  T^  and  T  as  fixed  pilot  parameters,  Miller  and  Vinje  sought 
to  adjust  the  other  pilot  parameters  (gains  and  leads)  to  match  the  measured 
performance  for  each  set  of  vehicle  parameters. 


(1) 


(2) 


2.  STATE  FEEDBACK  REPRESENTATION 

In  order  to  arrange  the  model  as  a  linear  state-feedback  system,  it  is 
necessary  to  split  the  pilot  model  into  two  parts.  One  for  the  fixed-lag  and 
delay  terms,  and  one  for  the  adjustable  terms.  The  intermediate  pilot  state 
thus  formed  is  called  Uc,  and  may  be  regarded  as  the  pilots  intended  or 


controlled  output.  Thus 


Uc  (s)  -  Kp0  (TlQ  s  +  1)  [-0(a)  +  Kpx  (TLx  s  +  1)  (-x  (s))] 

»  -Ko  s2  x(s)  -  Kt  8  x( s)  -  K2  x(s)-  K.j  s  0(s)-  K4  0(s) 


where:  Ko 


Kp0  Kpx  TL0  Tlx 


K,  "  KP©  KPx  <tL0  +  TLx> 

k2 

Ks  “  KPQTL0 
K„  -  KP0 

In  the  tine  domain,  we  therefore  have 

Uc(t)  -  -Ko  x(t)  -Kj  x(t)  -K2  x(t)  -Ks  S(t)  -K„  0(t)  ...(3) 

which  is  a  linear  combination  of  some  vehicle  states.  The  pilot  actually 
observes  x  and  0  only,  but  the  rate  terms  are  regarded  as  being  available 
since  the  differentiation  process  is  readily  performed  by  human  operators. 
The  remaining  term,  x,  is  implicit  in  x  and  0  as  seen  from  the  vehicle 
equation: 


-  KpgKpx 


x  -  U  -  -g/c  0  +  Xu  U  +  Xu  Ug 

when  the  latter  (disturbance)  term  is  deleted  as  outside 

u 
x 
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0 

,  Jr 


Thus  we  have: 
Uc(t) 


■b 


+  Ko  Xu 


K,  K  -  *-££ 
J  k  c 


3 


the  closed  loop. 


■  •  • 


(A) 


where  Yp  is  vector  of  available  states  and  Jlp  is  vector  of  feedback  gains. 

The  actual  pilots  output  is  thus  found 

u(s)  _  e  TS 
Uc(s)  (Tns  +  1) 

which  is  a  fixed  dynamic  element.  For  computational  purposes,  it  is  proposed 
to  include  this  with  the  vehicle  dynamics,  to  form  the  total  "plant".  The 
non-linear  delay  term  may  be  modelled  as  a  Pade  lead/lag  or  lag,  or  included 

with  the  neuromuscular  lag  T^ ,  in  order  to  make  a  suitable  linear  approximation. 


The  latter  course  was  taken  In  the  work  following  this.  Thus  we  hcve 


P(s)  «  1 

Uc(s)  <Tn  s  +  1) 


•  •  • 


(5) 


The  composite  model  is  illustrated  in  Figure  2.  This  form  is  suitable 
for  analysis  as  a  limited-state-feedback  control  system. 

3.  THE  HUMAN  PILOT  AS  A  SUB -OPTIMAL  CONTROLLER 

In  Physiology  and  Psychology,  it  has  long  been  held  that  the  human's 
adaptive  capabilities  are  used  to  optimize  some  criterion.  In  Control 
engineering,  the  work  of  Roig  [12]  was  first  to  recognize  the  strategy  of 
optimality,  albeit  constrained.  More  recently,  and  directly  relevant  to 
VTOL  tasks,  the  works  of  Kleinman  [3]  and  Dillow  [2]  reinforce  the  hypothesis 
that  the  human  controller  has  some  subjective  cost  function  which  he  seeks 
to  minimize  by  adapting  his  own  parameters. 

It  is  therefore  proposed  to  use  the  results  of  Levine  et.  al.  [7]  to 
predict  the  adjustable  feedback  terms  for  a  given  set  of  vehicle  parameters. 
Computationally,  this  is  very  attractive,  as  the  problem  tan  be  solved  rapidly 
by  the  method  of  successive  approximations.  This  contrasts  with  the  work  of 
Dillow  [2],  Hollis  [10],  and  Staple ford  [11],  where  the  optimal  parameters 
were  sought  by  function  minimization  methods  [8]  with  varying  speeds  and 
reliability. 

Use  of  the  optimal,  limited  state  feedback  model  of  Levine,  requires 

that  the  cost  function  be  quadratic  in  system  states  and  inputs.  In  our 

application,  this  may  be 
00 

Jp  =  SQ  (qtu2  +  q2x2  +  q3q2  +  q^G2  +  r  Uc2)  dt  ...(6) 

where  s^,  q2 ,  q^,  q^  and  r  are  weighting  coefficients.  The  latter  may  be 
normalized  to  unity.  Cross  product  terms  are  also  permissible. 
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APPLICATION  OF  THE  MODEL 


Use  of  the  model  demands  an  estimation  of  the  weighting  term,  qj^. 

This  then  becomes  the  model  fitting  or  identification  stage,  and  records  of 
pilot’s  behaviour  for  the  particular  task  must  be  examined. 

One  arbitrary  method  is  to  choose  weightings  such  that  each  element 
contributes  approximately  equally  to  the  cost  Jp,  when  typical  values  of 
u,  x,  q  and  6  are  inserted. 

However,  if  the  optimality  thesis,  and  the  above  format  of  Jp  (6)  are 
accepted,  a  more  rigorous  approach  is  to  analyse  the  system  as  an  inverse 
problem  in  optimal  control  [9]. 

Various  procedures  to  solve  this  problem  are  discussed  in  [5]  and  were 
used  to  analyse  the  data  of  Miller..and  Vinje.  For  each  vehicle  configuration 
(PHI  etc.),  the  feedback  vector  was  calculated  and  the  inverse  program  then 
determined  the  values  of  qJt  q2,  q3,  q4  which  would  produce  the  same  vector 
as  the  sub-optimal  (in  a  limited-state  feedback  sense)  control.  The  results 
are  presented  in  table  I.  It  must  be  noted  that  a  single,  universal,  cost 
function  does  not  exist,  and  minor  variations  in  q^  values  do  occur  for 
different  sets  of  vehicle  parameters.  The  mean  values  and  standard  deviations 

t 

are  given  below 


Mean 

Standard  Deviation 

*1 

-2.846 

1.1 

1.189 

0.5 

-0.114 

0.03 

% 

.728 

0.25 

The  negative  values  are  of  some  concern,  as  most  literature  in  optimal 
control  theory  refers  to  positive  definite  cost  functions.  There  is,  however. 


VEHICLE 


COMPUTED  PARAMETERS  FOR  Jp 
00 


DESIGNATION 

JP  “  f0  (chu2 

+  q2x2  +  q3q2 

+  qH  02+  uc2)  dt 

9i 

*2 

% 

PHI 

-2.26 

1.2 

-0.16 

0.65 

PH3 

-3.82 

1.79 

-0.14 

0.83 

PH4 

-4.19 

1.69 

-0.14 

1.05 

PH5 

-2.54 

0.86 

-0.10 

0.70 

PH7 

-1.95 

0.71 

-0.14 

0.57 

PH  8 

-2.59 

1.13 

-0.12 

0.65 

PH9 

-2.75 

1.27 

-0.10 

0.67 

PH  10 

-2.61 

1.24 

-0.09 

0.63 

PH  12 

-2.49 

1/10 

-0.14 

0.63 

PH17 

-1.95 

1.25 

-0.06 

0.36 

PH18 

-3.38 

1.75 

-0.09 

0.73 

PH  19 

-4.40 

2.27 

-0.08 

0.89 

PH21 

-4.80 

2.40 

-0.08 

0.96 

PH28 

-4.64 

1.60 

-0.14 

1.30 

PH  30 

-3.52 

1.34 

-0.14 

0.94 

PH31 

-2.52 

0.84 

-0.14 

0.83 

PH  32 

-2.16 

0.98 

-0.05 

0.49 

PH  34 

-1.98 

0.59 

-0.11 

0.66 

PH35 

-3.13 

1.44 

-0.15 

0.86 

PH  36 

-2.06 

— 

0.67 

-0.14 

0.75 

TABLE  I  RESULTS  OF  INVERSE  OPTIMAL  CONTROL  ANALYSIS  OF  PILOT-VTOL 
SYSTEMS.  (DATA  FROM  MILLER  AND  VINJE,  PILOT  B) 


-722- 


no  reason  why  an  optimal  control  cannot  exist  for  such  a  cost  function. 

Molinari  [13]  and  Kalman  [9]  indicate  the  existence  of  such  possibilities. 
Physically,  it  would  seem  that  the  cost  function  encourages  rate  terms  to  be 
large.  They  cannot,  however,  be  very  large  for  very  long  without  causing 
large  values  of  x  and  0  which  is  penalised  by  the  cost.  The  negative  weightings 
on  the  rate  terms  are  therefore  regarded  as  a  characteristic  of  a  low  damping 
system.  Obermaye.:  and  Muckier  [4]  found  negative  cost  values  for  their  manual 
control  systems,  although  a  different  model  was  used. 

Using  the  above  mean  values,  several  systems  were  analysed  to  predict 
pilot  parameters  using  the  forward,  sub -optimal  control  analysis.  These  results 
are  presented  in  Table  II  together  with  the  values  fitted  by  Miller  and  Vinje. 

The  agreement  between  the  two  sets  of  values  is  not  sufficient  to  claim 
the  method  as  a  successful  pilot  parameter  estimator.  This  is  to  be  expected 
from  the  consideration  of: 

(i)  the  Miller  and  Vinje  results  were  based  upon  "fitting"  the  model 
to  observed  system  data.  Another  combination  of  parameters  may  yield 
similar  performance. 

(ii)  the  nature  of  this  method  is  to  estimate  overall  performance 
rather  than  any  individual  parameter.  All  are  found  simultaneously  and 
considering  the  influence  of  the  others. 

(iii)  the  form  of  Jp  chosen  in  (6)  was  chosen  arbitrarily.  Other 
possibilities  with  many  more  parameters,  exist.  A  more  complex  cost 
matrix  may  give  a  better  fit. 

It  would  appear  that  the  model  is  useful  for  comparing  the  performance 
of  different  systems,  by  looking  at  the  pilot  parameters  and  overall  cost 
functions.  In  particular,  it  may  enable  a  best  set  of  compensation  parameters 


to  be  determined. 


VEHICLE 

COMPUTED  PARAMETERS 

FITTED  PARAMETERS 

DESIG¬ 

NATION 

Kp0 

TL0 

Kpx 

TLx 

Kpq 

TL0 

TLx 

PHI 

0.70 

0.37 

-1.2 

0.69 

0.69 

0.27 

-1.3 

0.91 

PH  3 

0.67 

0.28 

-i.3 

0.52 

0.73 

0.18 

-1.5 

0.39 

PH4 

0.69 

0.17 

-1.4 

0.41 

0.80 

0.16 

-1.4 

0.35 

PH  7 

0.67 

0.31 

-1.3 

0.57 

0.67 

0.10 

-1.2 

0.53 

PH  8 

0.67 

0.23 

-1.3 

0.50 

0.66 

0.16 

-1.4 

0.49 

PH9 

0.69 

0.15 

-1.3 

0.45 

0.64 

0.20 

-1.4 

0.50 

PH  12 

0.75 

0.22 

-1.2 

0.59 

0.76 

0.05 

-1.3 

0.56 

PH30 

0.68 

0.21 

-1.4 

0.36 

0.76 

0.20 

-1.3 

0.31 

PH34 

0.68 

0.17 

-1.3 

0.60 

0.68 

0.13 

-0.95 

0.60 

TABLE  II  COMPUTED  AND  FITTED  PILOT  PARAMETERS  FOR  THE  VTOL  HOVER 
TASK.  THE  COMPUTED  VALUES  USED  A  SINGLE  COST  FUNCTION 
Jp.  THE  FITTED  VALUES  ARE  FOR  MILLER  AND  VINJE'S  PILOT  B 


5. 


COMPENSATOR  DESIGN 


Compensation  in  manual  control  systems,  has  two  purposes; 

(i)  To  improve  performance  of  the  total  system  according  tc 

some  criterion  of  the  designer. 

(ii)  To  "unload"  the  pilot,  or  enable  him  to  achieve  the  same 

level  of  performance  with  less  effort. 

The  compensator  may  take  the  form  of  a  dynamic  element  somewhere  in 
the  loop,  or  augmented  feedback.  Different  configurations  may  be  arranged 
into  a  dual  controller  model  as  shown  in  Figure  3,  where  the  feedback  gains 
are  free  to  be  chosen  by  the  designer.  If  these  are  to  be  chosen  to  be 
optimal,  a  designer's  cost  function,  Jp,  must  be  defined. 

A  typical  and  appropriate  quadratic  cost  function  is 
00 

JD  -  /0  (AjU2  +  A2  x2  +  As  q2  +  A„  02  +  6£2)  dt  ...(7) 

where  Aj ,  A2,  As  and  A^  are  weighting  coefficients,  and  6C  is  the  control 
signal  from  the  compensator.  6C  must  be  weighted  so  that  it  does  not  become 
too  large  and  dominate  V>. 

The  choice  of  A^  values  will  reflect  the  designer's  experience,  and 
in  work  which  follows,  the  values 

Ai  “  As  ■  0 

A2  ■  kH  ■  1 
were  used. 

The  optimal  values  for  the  dual  controller  are  found  rapidly  using  the 
method  described  in  Anderson  [6].  The  essence  of  the  model  is  that  there  are 
two  controllers  with  two  (different)  cost  functions.  Both  sets  are  optimized 
simultaneously. 

Different  configurations  can  be  handled  by  choosing  the  plant  dynamics 
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to  irodel  the  problem.  Different  states  available  for  feedback  are  selected 
by  the  choice  of  the  observation  matrix. 

Various  configurations  based  on  the  PH8  vehicle  were  analysed  with 
different  feedback  permitted.  The  optimal  costs  and  Jp,  as  well  as  the 
computed  pilot  parameters,  are  shown  in  Table  III. 

It  should  be  noted  that  the  improvement  in  performance  is  accompanied 
by  a  large  decrease  in  the  inner  loop  gain  and  lead  terms,  Kpg  and  T^g*  The 
increase  in  the  outer  loop  terms  is  not  unreasonable,  as  the  model  is  a  series 
loop  model,  and  the  actual  pilot  feedback  gains  on  x  and  u  are  also  decreased. 
This  is  interpreted  as  a  decrease  in  the  pilot's  load  or  effort  required  to 
achieve  satisfactory  performance. 

Further,  the  same  technique  may  be  used  to  establish  the  design 
potential  of  a  particular  dynamic  element  placed  somewhere  in  the  loop.  By 
way  of  illustration,  a  control  lag  or  lead/lag  was  placed  in  the  loop  immeuiate 
ly  after  the  pilots  output,  as  shown  in  Figure  4,  such  that 

6p(s)  Tg  s  +  1 
y(s)  “  TA  s  +  1 

For  computational  purposes,  all  dynamic  elements  are  considered  as 
part  of  the  total  plant.  As  before,  the  signals  Uc  and  6£  are  regarded  as 

feedback  controls  to  be  optimized.  Table  IV  presents  the  results.  It  is 

0 

observed  that  there  is  no  significant  change  in  the  pilots  optimal  cost  Jp, 
while  the  designer's  cost  deteriorates  somewhat  for  the  time  constants  shown. 

A  smaller  inner  loop  gain  (Kpg)  is  evidenced  for  the  lag  controls,  but  this  is. 
accompanied  by  an  increase  in  the  inner  loop  lead  (Tgg) .  This  is  evidently 
generated  by  the  pilot  in  the  presence  of  the  control  lag.  A  higher  outer 
loop  gain  (Kpx)  is  also  required,  except  where  the  lead/lag  element  is  used. 


NONE  15.42  2.34  0.67  0.23  -1.3  0.50 


[  u  x  q  0]  7.43  2.04  0.26  -0.03  -2.03  0.66 

[p  u  x  q  6]  7.07  1.96  0.09  -0.004  -1.93  0.69 


TABLE  III  PILOT  PARAMETERS  AND  PERFORMANCE  COSTS  FOR  VARIOUS 
FEEDBACK  CONFIGURATIONS,  BASED  ON  VEHICLE  PI18. 


The  consequence  of  other  dynamic  elements  may  be  estimated  in  the  same 

way. 

6.  CONCLUSION 

With  some  simplifications  and  approximations,  the  above  technique  can 
be  used  to  model  many  design  configurations  which  may  be  considered  appropriate 
for  man-machine  systems.  The  well  established  results  o':  modem  control 
theory  can  then  be  used  to  predict  the  best  set  of  parameters  (both  pilots  and 
augmented  feedback  gains) .  The  principal  advantage  of  the  method  is  that  small 
amounts  of  computer  time  are  required  to  produce  an  estimation  of  the  potential 
of  any  such  configuration,  and  some  of  the  costs  and  parameters  which  may  result. 

It  must  be  recognized  that  the  technique  is  not  accurate  for  the 
prediction  of  pilot  parameters  alone.  Kleinman's  model  provides  good  accuracy, 
but  is  not  useful  here  as  the  order  of  the  total  system  (pilot  plus  vehicle)  is 
too  large  for  the  numerical  treatment  described  in  this  paper. 

The  results  quoted  in  the  paper  provide  a  basis  for  comparing  different 
design  configurations,  including  feedback  and  control  lead/lag  elements.  These 
are  submitted  as  further  evidence  of  the  value  of  optimal  control  theory  to  the 
analysis  and  understanding  of  the  man-machine  systems. 
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constant  to  convert  radians  to  degrees,  57.3 
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gravitational  constant,  32.2  ft.  sec 
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pilot  gain  in  displacement,  deg.  (ft.)  * 
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speed  stability  parameter,  rad  (ft.  sec)  * 
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pitch  rate,  deg  (sec) 

Laplace  Operator 

Pilot  lead  time  in  longitudinal  displacement,  sec 
Pilot  lead  time  in  pitch,  sec. 

Pilot  neuromuscular  lag,  sec. 

Longitudinal  Aircraft  Velocity,  ft  (sec)  * 

Pilot' t  control  output,  in. 

Longitudinal  wind  gust  velocity,  ft. (sec)  * 
white  noise 

longitudinal  displacement,  ft. 

Longitudinal  drag  parameter,  (sec)  * 

Pilot  Transfer  Function  in  displacement  (outer  or  x)  loop 
Pilot  Transfer  Function  in  pitch  (inner  or  0)  loop 
Control  input  to  vehicle,  in. 
pitch  attitude,  deg.  ^ 

Net  output  from  pilot,  in 
Pilot  Reaction  Time  delay 
Wind  gust  break  frequency,  .314  rad  (sec)  * 
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FIGURE  1  SERIES  LOOP  MODEL  FOR  PILOT  LONGITUDINAL  CONTROL  IN  HOVER 
(MILLER  AND  VINJE) 


FIGURE  2  STATE  FEEDBACX  REPRESENTATION  OF  THE  SERIES  LOOP  MODEL 
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PLANT  (VEHICLE  ONLY) 


FIGURE  3  THE  MANUAL  CONTROL  SYSTEM  AS  A  DUAL  SUB-OPTIMAL  CONTROLLER 


FIGURE  4 


LOCATION  OF  THE  CONTROL  LEAD/LAG  COMPENSATORY  ELEMENT. 


PAPER  PILOT  MAKES  A  BLIND  LANDING 
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ABSTRACT 

A  mathematical  prediction  scheme  was  developed  to  predict 
the  pilot  rating  for  the  longitudinal  handling  qualities  of 
aircraft  flown  on  the  glide  slope  in  turbulence.  Actual  pilot 
ratings  and  rms  performance  data  were  obtained  from  a  fixed- 
base  simulation  of  various  aircraft  configurations  represented 
by  the  longitudinal  short-period  equations  of  motion.  A 
linear  equation  was  developed  which  expressed  pilot  ratings 
from  the  fixed-base  simulation  as  a  linear  function  of  rms 
pitch  angle,  rms  pitch  rate,  and  rms  glide-path  deviation. 

The  pilot-vehicle  system  was  ^thematically  modeled  by  a 
closed-loop  feedback  system.  Certain  parameters  of  the  pilot 
model  used  in  the  system  were  selected  to  minimize  the  linear 
rating  expression  developed  from  the  fixed-base  simulation. 
Since  pilot  rating  was  expressed  as  a  linear  blend  of  rms 
performances,  predicted  ratings  were  analytically  obtained 
for  each  configuration. 

All  pilot  ratings  obtained  fr  >m  the  mathematical  predic¬ 
tion  scheme  were  within  ♦  1.05  rating  units  of  the  actual 
rating  from  the  fixed-base  simulation.  The  closed-loop  rms 
pitch  angle  and  rms  pitch  rate  also  agreed  fairly  well,  but 
preu  .led  rms  glideslope  deviation  did  not  correlate  with  the 
actual  rms  tracking  deviation. 

The  mathematical  prediction  scheme  was  applied  to  an 
independent  flight  data  source  for  aircraft  being  flown  in 
turbulent  approach  conditions.  In  94%  of  the  configurations 
tested,  the  predicted  evaluation  was  within  t  1.5  rating  units 
of  the  actual  pilot  rating.  The  maximum  difference  was  2.07 
rating  units. 

INTRODUCTION 

The  paper  pilot  concept  for  predicting  aircraft  handling 
qualities  in  a  specified  piloted  task  is  based  on  the  following 
hypothesis . 

1.  For  a  well  defined  task,  the  pilot  rating  is  a  func¬ 
tion  of  the  closed  loop  performance  and  the  pilot  workload. 

This  function  is  called  the  pilot  rating  expression. 


‘Currently  assigned  to  the  6585  Test  Group,  Holloman  AFB, 
New  Mexico. 
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2.  The  predicted  pilot  rating  can  be  obtained  by  mini¬ 
mizing  the  pilot  rating  expression  with  respect  to  free  pilot 
parameters  in  the  closed  loop  pilot-vehicle  model.  (The  lower 
the  rating--the  better  the  handling  qualities.)  The  minimal 
value  of  the  pilot  rating  expression  corresponds  to  the  pilot 
rating  for  the  task. 

The  paper  pilot  concept  has  been  demonstrated  in  the  past 
for  various  tasks  including  longitudinal  hover,  pitch  tracking, 
roll  attitude,  and  heading  tasks  (Refs  1  through  5).  In  this 
study  the  paper  pilot  concept  is  applied  to  the  task  of 
tracking  glideslope  in  a  turbulent  environment  and  a  method 
for  predicting  handling  qualities  is  described. 

In  this  paper  the  simulation  study  used  to  collect 
performance  data  and  pilot  ratings  is  briefly  described.  For 
the  cases  simulated,  the  pilot  rating  tends  to  correlate  linearly 
with  rms  pitch  angle,  pitch  rate  and  glideslope  deviation.  The 
formula  that  describes  this  correlation  is  the  pilot  rating 
expression.  A  fixed  form  pilot  model  is  described  and  predicted 
(or  paper  pilot)  ratings  are  computed  by  minimizing  the  pilot 
rating  expression  with  respect  to  four  free  parameters  in  the 
pilot  model.  These  results  are  compared  to  the  actual  pilot 
ratings  from  the  simulation.  This  method  of  predicting  pilot 
rating  was  also  used  for  a  set  of  aircraft  configurations 
which  had  been  evaluated  for  longitudinal  handling  in  a  simula¬ 
tion  conducted  by  North  American  Aviation  (Ref  6).  The  paper 
pilot  ratings  are  compared  to  the  actual  pilot  ratings  for  this 
independent  data  base. 

Details  of  this  paper  can  be  found  in  Ref  7. 

SIMULATION 

The  object  of  the  simulation  was  to  obtain  the  "data  base" 
for  aircraft  flying  the  glideslope  and  to  use  this  information 
in  formulating  a  pilot  rating  expression.  The  system  variables, 
or  states,  chosen  to  represent  aircraft  performance  are  aircraft 
pitch  angle,  pitch  rate,  angle  of  attack,  and  deviation  from 
desired  glide  path.  The  overall  simulation  is  represented  by 
the  functional  representation  of  Fig.  1. 

The  aircraft  dynamics  were  represented  by  short  period 
equations  of  motion.  That  is,  the  phugoid  mode  (longitudinal 
velocity  perturbations)  was  neglected.  It  was  assumed  that 
the  pilot  would  be  predominantly  sensitive  to  the  short  period 
states--pitch ,  pitch  rate,  vertical  velocity--in  an  evaluation 
of  the  longitudinal  handling  qualities. 

The  glide  path  geometry  is  shown  in  Fig.  2.  The  quantity 
displayed  to  the  pilot  is  angular  deviation,  T,  from  the 
nominal  glide  path.  During  an  actual  ILS  approach,  as  the 


runway  is  approached,  the  angular  deviation  from  nominal 
glide  path  angle  becomes  increasingly  sensitive  to  both 
angle  of  attack  changes  and  pilot  inputs.  The  relationship 
between  glide  path  deviation,  d,  and  angular  deviation  frcm 
nominal  glide  path  is 

~  »  tan  T  *  T  (radians) 

K 

where  R  is  the  distance  to  the  glideslope  transmitter  in 
feet . 

In  order  to  maintain  a  time-invariant  and  linear  problem, 
it  is  necessary  for  R  to  be  constant.  This  constraint  can  be 
justified  by  considering  the  pilot's  behavior  as  the  aircraft 
approaches  a  decision  height.  Decision  height  is  the  absolute 
altitude,  normally  between  100  feet  and  300  feet,  where  the 
pilot  decides  either  to  land  visually  or  to  execute  an  instru¬ 
ment  "missed  approach".  It  is  chosen  by  considering  a  number 
of  factors  which  include  aircraft  maneuverability,  weight,  and 
forward  airspeed.  Since  the  most  critical  portion  of  the 
instrument  approach  occurs  as  the  aircraft  nears  decision 
height,  it  is  assumed  that  the  overall  pilot  rating  is  decided 
at  this  time.  The  range  R  is  selected  for  each  aircraft  con¬ 
figuration  so  that  the  aircraft  is  being  flown  near  this  height. 

A  force  stick  was  used  by  the  pilot  to  command  elevator 
input.  The  pilot  was  allowed  to  adjust  the  stick  sensitivity 
to  a  preferred  value.  In  this  way,  the  pilot  rating  is  not 
influenced  by  an  adverse  stick  sensitivity. 

Elevator  dynamics  were  modeled  by  a  first  order  lag  with 
a  relatively  high  band  width. 

Only  vertical  gusts  were  considered  in  the  simulation. 

An  approximation  to  the  Dryden  gust  model  (Ref  8)  was  used. 

The  gust  is  generated  by  passing  white  Gaussian  noise  through 
a  first  order  filter.  A  rms  gust  intensity  of  10  ft/sec  was 
used  in  the  simulation. 

Pitch  attitude  and  deviation  from  glide  path  were  dis¬ 
played  to  the  pilot  using  a  dual-beam  oscilloscope  mounted  at 
eye  level.  The  relative  scaling  of  these  quantities  is 
illustrated  in  Fig.  3.  This  display  provides  implicit  informa¬ 
tion  concerning  pitch  rate  and  rate  of  deviation  from  glide 
path.  Vertical  velocity  and  aircraft  "g"  loading  were  displayed 
on  separate  instruments. 

A  hodge  podge  of  twelve  configurations  were  simulated. 

Five  of  the  aircraft  configurations  were  based  on  cases 
studied  in  a  flight  test  (Ref  9),  four  of  the  configurations 
were  based  on  B-l  Bomber  data,  two  of  the  configurations  were 
conjured  up  to  give  bad  pilot  ratings,  and  the  last  case  is 
a  DC-8. 
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Fig.  3.  Oscilloscope  Display. 


Four  Military  pilots  participated  in  the  simulation. 

Each  pilot  was  convinced  that  any  attempt  to  model  their 
behavior  was  ludicrous  and  they  were  anxious  to  debunk  the 
paper  pilot  theory  with  solid  data.  Each  pilot  was  thoroughly 
trained  with  each  configuration  before  data  was  taken.  The 
Cooper-Harper  rating  scale  was  used  for  numerical  pilot 
ratings  (Ref  8) . 


PILOT  RATING  EXPRESSION 


The  data  taken  from  the  simulation  was  used  to 
linear  correlation  between  rms  values  of  the  states 
rating.  The  possibility  of  an  additive  constant  or 
considered  and  a  formula  with  negative  coefficients 
considered.  The  answer  was  not  unique  and  the  five 
formulas  are  as  follows: 
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in  degrees/second, 


The  last  formula  was  used  as  the  pilot  rating  expression 
for  a  couple  of  reasons.  First  of  all,  it  includes  a  term 
involving  the  rms  glideslope  deviation  which  represents  the 
primary  task.  If  doesn't  appear  in  the  pilot  rating  expres¬ 
sion,  the  subsequent  method  for  determining  the  pilot  model 
would  result  in  a  pilot-vehicle  model  that  would  not  track 
glideslope.  The  second  reason  for  using  the  last  formula  is 

because  it  doesn't  include  a  term  involving  a.  or  a„  .  This 

6e  oe 

was  because  of  a  limitation  in  the  computer  program  that  existed 
at  the  time. 


PAPER  PILOT 

An  analytic  model  of  the  closed  loop  pi  lot -vehicle  system 
was  used  to  predict  pilot  rating  and  system  performance. 

The  pilot  model  is  shown  in  Fig.  4.  The  model  includes 
an  outer  loop  transfer  function. 
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Fig.  4.  Pilot  Model. 
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an  inner  loop  transfer  function, 


VTL0S  +  15 

”T  s  +  1 
10 


and  a  pure  time  delay,  e“Ts.  The  following  parameter  values 
are  used. 


x  *  .3  sec 

T  «  .01  sec 
I  d 

TI0  =  .1  sec. 


The  other  pilot  parameters,  K^,  T^,  Kg  and  T^0 ,  are  free 
parameters  in  the  minimization  scheme. 

The  predicted  pilot  rating  and  performance  is  obtained 
in  the  following  manner.  The  free  pilot  parameters  are 
selected  to  minimize 


J  «  . 36o  ♦  .960  ♦  .110. 

6  q  d 

for  the  closed  loop  pilot-vehicle  system.  The  disturbance 
is  a  vertical  gust  with  an  rms  intensity  of  10  ft/sec.  The 
paper  pilot  rating,  PR,  is  given  by 

fl  ,  J  <  1 

PR  ■  < d  ,  1  <  J  <  5.5 

11/2  (5 . 5  + J)  ,  J  >  S  .5 

|l0  ,  j  >  14. S 

This  final  fudge  to  arrive  at  the  paper  pilot  rating  reflects 
two  additional  considerations.  First,  the  pilot  rating  can 
never  be  less  than  one  or  greater  than  10.  Secondly,  the 
form  for  PR  is  also  based  on  the  assumption  that  once  the 
performance  deteriorates  beyond  a  certain  point,  a  further 
deterioration  of  performance  is  not  as  consequential  in  the 
pilot  rating. 


A  comparison  of  the  paper  pilot  ratings  and  those 
obtained  in  the  simulation  is  shown  in  Fig.  5.  The  paper 
pilot  ratings  are  within  t  1.05  rating  units  of  the  actual 
pilot  ratings  in  all  cases. 

Scatter  diagrams  relating  actual  and  predicted  values 
for  0  ,  o  and  a.  are  shown  in  Figs.  6  through  8.  Paper 

v  M  a 

pilot  accurately  predicts  the  actual  rms  value  of  pitch  rate, 
a  ,  but  it  is  slightly  high  in  predicting  a  .  There  is  no 

H  v 

apparent  correlation  between  predicted  and  actual  values  for 


TESTING  PAPER  PILOT 


The  paper  pilot  scheme  was  tested  against  an  independent 
data  base  developed  by  North  American  Aviation,  Inc.  (Ref  7). 

In  the  study  by  North  American  Aviation,  various  aircraft 
configurations  were  pilot  evaluated  for  the  carrier  approach- 
to-landing  task.  A  visual  flight  simulator  was  flown  by 
experienced  pilots  to  determine  the  overall  rating.  A  large 
number  of  control  and  configuration  parameters  were  varied 
during  the  carrier  approach  simulation.  Because  of  this,  care 
was  exercised  to  select  only  those  configurations  for  test  which 
manipulated  th  short  period  dynamics  and  which  were  flown  with 
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Actual  Rating  (Cooper-Harper  Scale) 

Fig.  5.  Predicted  Pilot  Ratings  vs. 
Pilot  Ratings  from  Analog  Simulation 


H  INNINfl  •■■N  >M»*  -  1 .  <  1INHn.HniiUMMM||| 

Be  'Ml.  '•••■••■■•a 

■« 

■I  iiiaiaiaMiiinni'  -  t'.rinii  .■■aaaaiaiiaiiaiyaiMi| 

la  iaaiaaaaa«a»iaiaaaaaaaaait  «Hiiaw|f  ilMWliil 
la  niaiiHNMiii aaaai ■  aaaa  ,•■■■  iaaa(aaaNHiiaaiM>| 


M  BMIIIa-  •  Hl>  <l— ■WMWMiMlWW 1M||«|||H| 
Bf  MiMffim  i.  i.iiiiiiifiMHniiHaiiHmiiiiMml 

- ^gar'  - 


■■  ■  ■  ■  ■■■■■■■■■■■■ 

■■ »§•••  i  <i*i  v  .■■•■■••■aMMMMMiiaMMaaaMMMMiMiiiiiiiiiiB 

Wm  .  ■ *  ,aiiaaiaia ■■■■■■■■■■■ ■■■■■a ■■■■■■■■■••■■■ ■ 

■  •  IIMli-il.llllllllllllllllllliaiMMIIIIMIMiaillil 
■a  ■■■  M  iiiii«iMiMiiainiiiHniHiiiiiiiiiii|iii| 
E  ■»•«*>  >aiM>iia.*t«aiiiiatiiMMa*iio<aaiM«a*a 


Actual  RMS  Pitch  Angle  (Degrees) 


Fig.  6.  Predicted  RMS  Pitch  Angle  vs 
Pitch  Angle  from  Analog  Simulation. 


optimum  stick  sensitivity.  Using  this  criteria,  the  linearized 
equations  of  motion  were  determined  for  17  different  configura¬ 
tions  . 


The  gust  variance  was  difficult  to  determine  since  a 
three-dimensional  turbulence  model  was  used  by  North  American 
Aviation.  In  addition  to  this  stochastic  gust  input,  the 
longitudinal  and  vertical  axes  were  subject  to  gust  inputs 
that  were  a  function  of  distance.  From  the  results  of  trial 
solutions  for  two  of  the  configurations,  it  was  decided  that 
the  equivalent  rms  disturbance  should  be  5.5  feet  per  second. 
This  value  of  o  was  constant  for  all  of  the  test  configura¬ 
tions.  g 


The  accuracy  of  the  paper 
the  scatter  diagram  of  Fig.  9. 
tions,  the  paper  pilot  ratings 
of  the  actual  evaluation.  The 
2.07  units. 


pilot  ratings  is  depicted  by 
For  97%  of  the  test  configura- 
are  within  +  1.5  rating  units 
maximum  rating  difference  was 


CONCLUSIONS 


The  paper  pilot  scheme  was  applied  to  the  task  of  tracking 
glideslope  in  turbulence.  The  pilot  rating  tends  to  correlate 
linearly  with  rms  pitch  attitude,  rms  pitch  rate,  and  rms  glide 
slope  deviation.  The  pilot  ratings  predicted  by  paper  pilot 
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Fig.  9.  Predicted  Pilot  Ratings  vs.  Actual 
Pilot  Ratings  for  North  American  Test 
Configurations  . 


agree  reasonably  well  with  actual  ratings.  Even  when  applied 
to  a  data  set  other  than  the  one  used  to  develop  the  pilot 
rating  expression,  the  paper  pilot  ratings  agree  reasonably 
well  with  actual  rating.  The  analytic  values  of  rms  pitch  and 
rms  pitch  rate  agree  well  with  actual  data.  However,  there  is 
no  correlation  between  the  analytic  values  of  glideslope 
deviation  and  those  measured  in  the  simulation. 

An  examination  of  the  simulation  data  revealed  that  the 
pilot  rating  tended  to  correlate  with  o^e  and  o^.  Although 

these  possibilities  were  not  pursued  in  this  study,  it  is 
conjectured  that  these  terms  relate  to  the  pilot  work  load. 

In  previous  paper  pilot  studied,  work  load  was  related  to  the 
values  of  pilot  lead  (T^)  that  were  used  to  minimize  the  pilot 

rating  expression.  The  use  of  rms  control  rate  in  the  pilot 
rating  expressions  is  well  suited  to  the  use  of  an  optimal  pilot 
model  developed  by  Kleinman,  Baron,  and  Levison  (Ref  10).  This 
may  be  worth  further  study. 

YOU  DONE  GOOD,  PAPER  PILOTI 
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